-- Logs begin at Thu 2022-08-18 19:38:43 UTC, end at Thu 2022-08-18 21:19:47 UTC. -- Aug 18 20:32:32.280005 dv-cinder-852654-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 20:32:32.290235 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 20:32:32 2022] *** Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: nodename: dv-cinder-852654-2-iscsi Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: machine: x86_64 Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: clock source: unix Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: pcre jit disabled Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: detected number of CPU cores: 4 Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: current working directory: / Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: detected binary path: /usr/bin/uwsgi-core Aug 18 20:32:32.292065 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: your processes number limit is 47680 Aug 18 20:32:32.292690 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: your memory page size is 4096 bytes Aug 18 20:32:32.292690 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: detected max file descriptor number: 2048 Aug 18 20:32:32.292690 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: lock engine: pthread robust mutexes Aug 18 20:32:32.292690 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: thunder lock: enabled Aug 18 20:32:32.292690 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 20:32:32.292690 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 20:32:32.331994 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: Python main interpreter initialized at 0x559e8ee719c0 Aug 18 20:32:32.331994 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: python threads support enabled Aug 18 20:32:32.331994 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: your server socket listen backlog is limited to 100 connections Aug 18 20:32:32.331994 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: your mercy for graceful operations on workers is 90 seconds Aug 18 20:32:32.332351 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 20:32:32.332431 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: *** Operational MODE: preforking *** Aug 18 20:32:32.332700 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: *** uWSGI is running in multiple interpreter mode *** Aug 18 20:32:32.332700 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: spawned uWSGI master process (pid: 88536) Aug 18 20:32:32.332901 dv-cinder-852654-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 18 20:32:32.339395 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: spawned uWSGI worker 1 (pid: 88548, cores: 1) Aug 18 20:32:32.339395 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: spawned uWSGI worker 2 (pid: 88549, cores: 1) Aug 18 20:32:32.339395 dv-cinder-852654-2-iscsi devstack@keystone.service[88536]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 20:32:36.735426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:32:36.735426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: from cryptography.utils import int_from_bytes Aug 18 20:32:36.736217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:32:36.736217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: from cryptography.utils import int_from_bytes Aug 18 20:32:36.736620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:32:36.736620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: from cryptography.utils import int_from_bytes Aug 18 20:32:36.736734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:32:36.736734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: from cryptography.utils import int_from_bytes Aug 18 20:32:36.786176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:32:36.786386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:32:36.786504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:32:36.786601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] command line args: [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:32:36.786683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:32:36.786798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:32:36.786877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] command line args: [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:32:36.786976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ================================================================================ {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:32:36.787051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:32:36.787215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] admin_token = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.787294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ================================================================================ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:32:36.787496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] config_dir = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.787616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] admin_token = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.787711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.787793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] config_dir = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.787865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] config_source = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.787932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] debug = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] config_source = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] debug = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.788930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] list_limit = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] log_config_append = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] log_config_append = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.789967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] log_dir = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.790351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] log_dir = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.790502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] log_file = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.790638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] log_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.790758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.790825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.790954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.791259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.791434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.791603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.791777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.791910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.791999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.792123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.792204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.792311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.792434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.792510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.792635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.792894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793687 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.793990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] publish_errors = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] publish_errors = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.794940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] standard_threads = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.795974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] standard_threads = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.796043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.796158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.796231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.796311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.796422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] use_journal = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.796544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.796618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] use_json = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] use_journal = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] use_stderr = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] use_json = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] use_syslog = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] use_stderr = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] use_syslog = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.797902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:32:36.797975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.798907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.799960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.800911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.801889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.802855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.803035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.803112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.803287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.803406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.811511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.811643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.811759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.811833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.811892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.812018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.812142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.812224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.812376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.812982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.813925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.814843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.815937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.816990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.817951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.818895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.819996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820366 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820452 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.820935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.821976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822736 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.822933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.823948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.824975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] auth.external = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.external = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.825997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] auth.password = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] auth.token = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.password = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] auth.token = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.826949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] credential.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.827844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.828463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.828546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.828646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.828742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.828815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.828885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.828998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.829999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.830964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.831133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.831239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.831381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.831482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.831643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.831795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.831872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.832899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.833873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.834017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.834097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.834255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.834343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.834712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.834956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.835241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.835550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.835647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.835856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.835935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.835935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.836217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.836217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.836479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.836716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.836955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.837030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.837248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.837330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.837539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.837749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.837831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.838027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.838087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.838292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.838802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.839298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.845487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.845487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.845756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.845855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.845941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846011 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846919 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.846992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.847982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848315 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.848974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.849967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850107 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.850962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.851039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.851111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.851187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.851259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.851328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.851412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.857983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.858943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.859969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.860973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.861969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862369 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] role.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] role.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.862929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] role.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] role.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.863942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.864986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865537 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.865997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.866934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.867996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.868987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869656 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.connection = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.869980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.870956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.871974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.872125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.872208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.872364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.872449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.872599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.872678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.872768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:32:36.872838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.873094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.873328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.873575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.873814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:32:36.873991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:32:36.902918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.903130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.909909 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.910050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.910050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.910050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.912417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.913428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.940813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.941195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.941543 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.941768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.995732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:36.996111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.045439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.045737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.046422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.046691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.209750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.210021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.210195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.210400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.210624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.210844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.211007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.211245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.211501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.211730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.211951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.212168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.241624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.241844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.242076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.242303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.242540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.242814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.243198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.243298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.243461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.243698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.243927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.244193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.244421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.244642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.255022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.255397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.268359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.268593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.268800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.268888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.269917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.270133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:32:37.294384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.294571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.294657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:32:37.294786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:32:37.294932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.295133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.295216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:32:37.295337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:32:37.295450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.295648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.295732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.295917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.296208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.296291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.296486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.296569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.306447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.306723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.306822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.306999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.307091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.307272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.307379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.307596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.314350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.314576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.317289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.317533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.317626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.317805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.320678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.320767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.320830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.320890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.320962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.321925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.342818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.343129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.344881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.350347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.351095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.351221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.351299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.351405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.351485 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.351559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.351631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.351703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.356859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.357110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.357198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.357408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.361822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.362117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.362265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.362401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.362568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.362697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.362829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.362975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.363115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.363283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.363441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.363580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.363714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.363853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.363986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.364115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.381639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.381920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.382122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.382414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.385814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.386377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.389067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.389364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.389892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.390197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.394402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.394972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.397591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.398163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.400876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.401181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.401425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.401553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.401731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.401862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.402022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.402151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.402313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.402450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.402593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.402858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.418254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.418542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.418817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.418947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.419074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.419200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.419398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.419665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.426050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.426588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.427613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.427896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.428171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.428453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.430579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.430866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.431136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.431275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.431444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.431570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.431730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.431859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.432044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.432329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.443942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.444235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.444524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.444814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.445099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.445379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.445668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.446424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.446716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.447008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.447306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.447622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.447919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.448205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.461690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.464408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.464772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.467629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.467777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.469184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.470625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.470761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.470946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.471248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.472281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.478445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.478445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.478445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.478666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.479220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.480948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.482173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.482419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.482521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.482747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.483034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.486123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.486421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.486714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.487001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.491577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.491874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.492158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.495025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.495320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.495633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.499083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.499381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.499681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.500520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.500800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.501088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.501368 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.501643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.501927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.502218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.502496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.502761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.503049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.503142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:32:37.503316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.503452 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.503715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.503996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.504274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.504562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.504841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.505161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.505409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.505692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.505969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.506234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.506512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.506777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:32:37.537762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559e8ee719c0 pid: 88549 (default app) Aug 18 20:32:37.541295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812152-a119-4709-9dac-1927de6de960 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:37.541401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559e8ee719c0 pid: 88548 (default app) Aug 18 20:32:37.541585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812152-a119-4709-9dac-1927de6de960 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:37.541861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812152-a119-4709-9dac-1927de6de960 None None] PATH_INFO: `/v3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:37.546031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Thu Aug 18 20:32:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:45.340688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b120-ff00-495f-b8b6-26584a84db6c None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:45.341216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b120-ff00-495f-b8b6-26584a84db6c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:45.341324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b120-ff00-495f-b8b6-26584a84db6c None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:45.346695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:45.352135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:45.352563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:45.352932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:45.424347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: INFO dbcounter [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] Registered counter for database keystone Aug 18 20:32:45.446264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG oslo_db.sqlalchemy.engines [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:32:45.452545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writer thread running {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:32:45.647429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG passlib.handlers.bcrypt [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88549) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:32:45.647946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG passlib.handlers.bcrypt [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88549) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:32:45.705341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:45.706949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:45.836276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:32:46.346621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b120-ff00-495f-b8b6-26584a84db6c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:46.415609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: INFO dbcounter [None req-c767b120-ff00-495f-b8b6-26584a84db6c None None] Registered counter for database keystone Aug 18 20:32:46.434820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG oslo_db.sqlalchemy.engines [None req-c767b120-ff00-495f-b8b6-26584a84db6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:32:46.441531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writer thread running {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:32:46.560471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b120-ff00-495f-b8b6-26584a84db6c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:46.565359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef9b0b-1a23-40fd-a32f-53927cda9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:46.566066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9b0b-1a23-40fd-a32f-53927cda9e16 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:46.566346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9b0b-1a23-40fd-a32f-53927cda9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:46.566620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9b0b-1a23-40fd-a32f-53927cda9e16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:46.574679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef9b0b-1a23-40fd-a32f-53927cda9e16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:46.625901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING keystone.common.rbac_enforcer.enforcer [None req-27ef9b0b-1a23-40fd-a32f-53927cda9e16 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:32:46.626169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef9b0b-1a23-40fd-a32f-53927cda9e16 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:46.636113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Thu Aug 18 20:32:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 20:32:46.642367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:46.656791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448f60-9357-4f77-bf17-a553b683c225 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:46.661246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb5453-623f-4c28-ab1b-61ac5a21d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:46.662432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5453-623f-4c28-ab1b-61ac5a21d352 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:46.662701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5453-623f-4c28-ab1b-61ac5a21d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:46.662972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5453-623f-4c28-ab1b-61ac5a21d352 admin admin] PATH_INFO: `/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:46.664566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb5453-623f-4c28-ab1b-61ac5a21d352 admin admin] RBAC: Authorizing `identity:get_project(project_id=e6113ebebf7b4a1a9829f6a6a5263233)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:46.716516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING keystone.common.rbac_enforcer.enforcer [None req-31eb5453-623f-4c28-ab1b-61ac5a21d352 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:32:46.716854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb5453-623f-4c28-ab1b-61ac5a21d352 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:46.721461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Thu Aug 18 20:32:46 2022] GET /identity/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:48.618462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96f7d-39c9-4235-a448-f103bb1e26a1 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:48.618957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96f7d-39c9-4235-a448-f103bb1e26a1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:48.618957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96f7d-39c9-4235-a448-f103bb1e26a1 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:48.623031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:48.628983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78263835-7202-47fd-ad12-2e4b1358b407 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:48.629394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78263835-7202-47fd-ad12-2e4b1358b407 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:48.629582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78263835-7202-47fd-ad12-2e4b1358b407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:48.650113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-78263835-7202-47fd-ad12-2e4b1358b407 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:48.651685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-78263835-7202-47fd-ad12-2e4b1358b407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:48.659496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:32:48.929743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96f7d-39c9-4235-a448-f103bb1e26a1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:48.941988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96f7d-39c9-4235-a448-f103bb1e26a1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:48.946313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211e67-5f0a-4e4a-80e9-2b12f810cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:48.946908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211e67-5f0a-4e4a-80e9-2b12f810cd0c admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:48.947182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211e67-5f0a-4e4a-80e9-2b12f810cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:48.947485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211e67-5f0a-4e4a-80e9-2b12f810cd0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:48.955541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f211e67-5f0a-4e4a-80e9-2b12f810cd0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:48.957317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f211e67-5f0a-4e4a-80e9-2b12f810cd0c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:48.965928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Thu Aug 18 20:32:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:32:48.972151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78263835-7202-47fd-ad12-2e4b1358b407 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:48.981232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78263835-7202-47fd-ad12-2e4b1358b407 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:48.985578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f309f7-476e-4d83-833d-5ba5da7ee143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:48.986202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f309f7-476e-4d83-833d-5ba5da7ee143 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:48.986486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f309f7-476e-4d83-833d-5ba5da7ee143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:48.986763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f309f7-476e-4d83-833d-5ba5da7ee143 admin admin] PATH_INFO: `/v3/users/2526f2a72f3a412d8bafb65717ad2b43` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:48.988114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f309f7-476e-4d83-833d-5ba5da7ee143 admin admin] RBAC: Authorizing `identity:get_user(user_id=2526f2a72f3a412d8bafb65717ad2b43)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:48.989935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f309f7-476e-4d83-833d-5ba5da7ee143 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:48.991551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Thu Aug 18 20:32:48 2022] GET /identity/v3/users/2526f2a72f3a412d8bafb65717ad2b43 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:50.992067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72eab-0d2c-444e-8324-10f62007d980 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:50.992633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72eab-0d2c-444e-8324-10f62007d980 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:50.992633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72eab-0d2c-444e-8324-10f62007d980 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:50.994068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:50.996953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64751-4ebc-4bef-b540-74386a028be1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:50.997368 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64751-4ebc-4bef-b540-74386a028be1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:50.997497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64751-4ebc-4bef-b540-74386a028be1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:50.998824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:50.999252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:50.999569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:50.999850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:51.003517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592ab6-564b-4c27-858b-905b295b8f63 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:51.003803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592ab6-564b-4c27-858b-905b295b8f63 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:51.004078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592ab6-564b-4c27-858b-905b295b8f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:51.022181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-01592ab6-564b-4c27-858b-905b295b8f63 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:51.023389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-01592ab6-564b-4c27-858b-905b295b8f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:51.042555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG passlib.handlers.bcrypt [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88548) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:32:51.042979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG passlib.handlers.bcrypt [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88548) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:32:51.088246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:51.089824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:51.103099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 7/12] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:32:51.186775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 6/13] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:32:51.370631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01592ab6-564b-4c27-858b-905b295b8f63 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:51.396026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:51.462544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:51.476764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01592ab6-564b-4c27-858b-905b295b8f63 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:51.511899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:51.512519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:51.512799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:51.513074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:51.575415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfe970-5098-45be-b2a5-2df7f1faa032 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:51.578288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:51.581161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:51.582652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:51.605535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:51.614567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:51.615689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:51.615973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:51.616251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:51.628475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:32:51.638129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:32:51.639052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:32:51.640766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:32:51.646052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:51.680606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 8/15] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:32:51.686040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:51.747274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85b33-8fcc-4453-bb32-46aa5d69fafb None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:51.781212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:51.781830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:51.782115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:51.782394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:51.783067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:32:51.783392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:51.784917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:51.789407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e97d7-5f3d-4195-accc-8aeb1a219bf6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:51.797056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 8/16] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:51.802622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:51.813810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:51.825341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:51.825977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:51.826316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:51.826602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:51.830288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:51.837014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:51.838485 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:32:51.857517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:32:51.858436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:32:51.859599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:32:51.859599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:32:51.859599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:32:51.859599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:32:51.864393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:51.904092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa526af0-7f88-4f49-8880-84fb9815a6c4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:51.937682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:51.938327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:51.938610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:51.938886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] PATH_INFO: `/v3/users/2526f2a72f3a412d8bafb65717ad2b43` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:51.940378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=2526f2a72f3a412d8bafb65717ad2b43)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:51.941841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:51.943523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 9/18] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:32:51 2022] GET /identity/v3/users/2526f2a72f3a412d8bafb65717ad2b43 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:51.949112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:51.968658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792398f3-ca62-4a31-9f40-59de9a511a3a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:52.002546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:52.003197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:52.003470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:52.003747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:52.004413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:32:52.004930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:52.006116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:52.024145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 10/19] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:52.046602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:52.053503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b975-cccd-4ad7-9988-03fab8bad6f5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:52.090203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f010dc-f35f-407e-9e39-6b2f95bbe551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:52.090847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f010dc-f35f-407e-9e39-6b2f95bbe551 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:52.091129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f010dc-f35f-407e-9e39-6b2f95bbe551 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:52.091432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f010dc-f35f-407e-9e39-6b2f95bbe551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:52.092610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f010dc-f35f-407e-9e39-6b2f95bbe551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:52.094748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f010dc-f35f-407e-9e39-6b2f95bbe551 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:52.096498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 10/20] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:32:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:52.102622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:52.140622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:52.207884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a49d-5f64-4677-b7d9-fdf84d01f54c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:52.243712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0305-79dd-4196-a84d-f0862c3942bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:52.244336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0305-79dd-4196-a84d-f0862c3942bf None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:52.244616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0305-79dd-4196-a84d-f0862c3942bf None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:52.244888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0305-79dd-4196-a84d-f0862c3942bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:52.245637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0305-79dd-4196-a84d-f0862c3942bf None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.domain.id=default, user.id=2526f2a72f3a412d8bafb65717ad2b43) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:32:52.245954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0305-79dd-4196-a84d-f0862c3942bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:52.247443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0305-79dd-4196-a84d-f0862c3942bf None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:52.255006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 11/21] 10.222.0.62 () {56 vars in 1322 bytes} [Thu Aug 18 20:32:52 2022] GET /identity/v3/role_assignments?user.id=2526f2a72f3a412d8bafb65717ad2b43&scope.domain.id=default&role.id=5eebc7f04cfc4979a378bf94830482af => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:54.348860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e60d-9b72-4b70-8b19-5ecf4164ed0e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:54.349406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e60d-9b72-4b70-8b19-5ecf4164ed0e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:54.349406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e60d-9b72-4b70-8b19-5ecf4164ed0e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:54.350818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 11/22] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:54.361723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b690-cdf6-47c9-ba58-289c9349ca9b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:54.362193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b690-cdf6-47c9-ba58-289c9349ca9b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:54.362293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b690-cdf6-47c9-ba58-289c9349ca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:54.388624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1e79b690-cdf6-47c9-ba58-289c9349ca9b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:54.390361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1e79b690-cdf6-47c9-ba58-289c9349ca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:54.504379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:32:54.631398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187adbfe-641f-4547-987a-7303c796aea1 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:54.631724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187adbfe-641f-4547-987a-7303c796aea1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:54.631885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187adbfe-641f-4547-987a-7303c796aea1 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:54.633225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:54.638747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e257-6cab-44d0-8745-0e6923059395 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:54.639413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e257-6cab-44d0-8745-0e6923059395 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:54.640432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e257-6cab-44d0-8745-0e6923059395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:54.678539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4783e257-6cab-44d0-8745-0e6923059395 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:54.679769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4783e257-6cab-44d0-8745-0e6923059395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:54.718233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:54.810753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:32:54.867585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a25e3-281d-4317-ac8c-0e4f4986155a None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:54.872306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a25e3-281d-4317-ac8c-0e4f4986155a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:54.872594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a25e3-281d-4317-ac8c-0e4f4986155a None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:54.874324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 13/26] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:54.881088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f588a-04d2-41dd-a731-c91ab76ee342 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:54.881535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f588a-04d2-41dd-a731-c91ab76ee342 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:54.881772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f588a-04d2-41dd-a731-c91ab76ee342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:54.912684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-942f588a-04d2-41dd-a731-c91ab76ee342 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:54.914217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-942f588a-04d2-41dd-a731-c91ab76ee342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:55.033635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 14/27] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:32:55.101797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a25e3-281d-4317-ac8c-0e4f4986155a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:55.130547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d30a-3f8b-412b-ae7c-abb3fa9de663 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:55.130857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d30a-3f8b-412b-ae7c-abb3fa9de663 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:55.131145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d30a-3f8b-412b-ae7c-abb3fa9de663 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:55.132645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 15/28] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:55.137617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa1226-b83b-43ed-8c01-2dc38e68cb89 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:55.137902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa1226-b83b-43ed-8c01-2dc38e68cb89 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:55.138178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa1226-b83b-43ed-8c01-2dc38e68cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:55.180786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c3fa1226-b83b-43ed-8c01-2dc38e68cb89 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:55.182069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c3fa1226-b83b-43ed-8c01-2dc38e68cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:55.313733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a25e3-281d-4317-ac8c-0e4f4986155a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:55.331849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 16/29] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:32:55.336298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa1226-b83b-43ed-8c01-2dc38e68cb89 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:55.383822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:55.413026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:55.417024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:55.417024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:55.417024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:55.464236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:55.465730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:32:55.498336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:32:55.499867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:32:55.500675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:32:55.500675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:32:55.500675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:32:55.502471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 14/30] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:32:55.503452 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:55.528292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:55.583144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa1226-b83b-43ed-8c01-2dc38e68cb89 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:55.645911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:55.646482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:55.646774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:55.647053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:55.662835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:32:55.670821 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e352008-3fd5-4a6c-80a0-5a4cd0dee5fd None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:32:55.671396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:32:55.672247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:32:55.672985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 17/31] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:32:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:32:55.674012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:55.712676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:55.713612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:55.714470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:55.714948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:55.716049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:55.718582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:55.775853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:55.797630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300483-0a78-499c-980d-49a1402bc220 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:55.832080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72680a29-05d1-473a-9121-9583e04b0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:55.832946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680a29-05d1-473a-9121-9583e04b0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:55.833245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680a29-05d1-473a-9121-9583e04b0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:55.833523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680a29-05d1-473a-9121-9583e04b0dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:55.834391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72680a29-05d1-473a-9121-9583e04b0dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:32:55.835082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72680a29-05d1-473a-9121-9583e04b0dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:55.836213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72680a29-05d1-473a-9121-9583e04b0dc1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:55.853527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 18/32] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:55.853527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa629-7f45-44f3-b50e-b05b96b276bd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:55.853527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa629-7f45-44f3-b50e-b05b96b276bd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:55.853527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa629-7f45-44f3-b50e-b05b96b276bd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:55.853527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 19/33] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:55.856995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa629-7f45-44f3-b50e-b05b96b276bd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:55.940710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 15/34] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Aug 18 20:32:55 2022] POST /identity/v3/roles => generated 219 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:32:55.941548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:55.973705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa629-7f45-44f3-b50e-b05b96b276bd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:56.023249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d1bc3-c371-4553-a550-305281329d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:56.023910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d1bc3-c371-4553-a550-305281329d6b None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.024200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d1bc3-c371-4553-a550-305281329d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.024479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d1bc3-c371-4553-a550-305281329d6b None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.025176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d1bc3-c371-4553-a550-305281329d6b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:56.026601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d1bc3-c371-4553-a550-305281329d6b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:56.038763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:56.065443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e260-40e3-43a8-ba3d-d3001a1a08cb None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:56.084267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:56.108670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:56.109304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.109592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.109872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.110564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:32:56.110873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:56.112459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:56.121350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 16/35] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:56.127354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:56.235447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d75c-f3d2-4946-a20d-23f5703e28ef None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:56.279244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1acd8-d750-4c22-a962-fe38f3583cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:56.280928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1acd8-d750-4c22-a962-fe38f3583cc3 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.281425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1acd8-d750-4c22-a962-fe38f3583cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.282002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1acd8-d750-4c22-a962-fe38f3583cc3 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.282984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1acd8-d750-4c22-a962-fe38f3583cc3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:56.284532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1acd8-d750-4c22-a962-fe38f3583cc3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:56.291078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:56.306806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 20/36] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Aug 18 20:32:55 2022] POST /identity/v3/roles => generated 225 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:32:56.308330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b1472-8e61-4d9d-bffc-2d20cad288ff None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.308581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b1472-8e61-4d9d-bffc-2d20cad288ff None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.308837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b1472-8e61-4d9d-bffc-2d20cad288ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.329748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b88b1472-8e61-4d9d-bffc-2d20cad288ff None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:56.331515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b88b1472-8e61-4d9d-bffc-2d20cad288ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:56.413256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 21/37] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:32:56.414471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4034-cc48-4f78-a9ea-1cfdbed52298 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.414862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4034-cc48-4f78-a9ea-1cfdbed52298 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.415114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef4034-cc48-4f78-a9ea-1cfdbed52298 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.419669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 22/38] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:56.419669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef4034-cc48-4f78-a9ea-1cfdbed52298 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:56.426595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 17/39] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:32:56 2022] POST /identity/v3/projects => generated 301 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:32:56.438475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77df0-f46d-4c57-b645-2b7d98d9662e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.438961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77df0-f46d-4c57-b645-2b7d98d9662e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.439423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77df0-f46d-4c57-b645-2b7d98d9662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.473661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ade77df0-f46d-4c57-b645-2b7d98d9662e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:56.475517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ade77df0-f46d-4c57-b645-2b7d98d9662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:56.574855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 18/40] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:32:56.590856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef4034-cc48-4f78-a9ea-1cfdbed52298 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:56.626341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:56.635398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:56.636094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.636380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.636704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] PATH_INFO: `/v3/users/2526f2a72f3a412d8bafb65717ad2b43` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.637922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=2526f2a72f3a412d8bafb65717ad2b43)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:56.639887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:56.641560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 23/41] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:32:56 2022] GET /identity/v3/users/2526f2a72f3a412d8bafb65717ad2b43 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:56.647655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade77df0-f46d-4c57-b645-2b7d98d9662e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:56.697923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:56.769551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade77df0-f46d-4c57-b645-2b7d98d9662e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:56.794021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:56.815175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:56.815849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.816141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.816420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.818066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:56.820365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:56.822117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 19/42] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:32:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:56.827693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:56.840027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dd0ad-23c3-4ddf-b308-1b13b3a0b2d7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:56.878549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:56.879168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.879502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.879782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.880460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:56.881839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:56.937118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790e099-98b0-4645-a4bb-39bc847c502c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:56.963126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 24/43] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Aug 18 20:32:56 2022] POST /identity/v3/roles => generated 223 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:32:56.964100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:56.980440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:56.981612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:56.982307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:56.982747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] PATH_INFO: `/v3/domains/default/users/2526f2a72f3a412d8bafb65717ad2b43/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:56.985289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2526f2a72f3a412d8bafb65717ad2b43, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:56.987166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:57.027270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:57.072518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375817b7-8e6e-4ffa-b4ba-0aec855a0259 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:57.081270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 20/44] 10.222.0.62 () {58 vars in 1361 bytes} [Thu Aug 18 20:32:56 2022] PUT /identity/v3/domains/default/users/2526f2a72f3a412d8bafb65717ad2b43/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:32:57.117989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf006e44-d128-4ab8-8534-b6cd6f0f07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:57.118349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf006e44-d128-4ab8-8534-b6cd6f0f07fd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:57.118616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf006e44-d128-4ab8-8534-b6cd6f0f07fd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:57.118896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf006e44-d128-4ab8-8534-b6cd6f0f07fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:57.120153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf006e44-d128-4ab8-8534-b6cd6f0f07fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:57.121628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf006e44-d128-4ab8-8534-b6cd6f0f07fd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:57.124587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 25/45] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:32:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:57.130830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:57.188518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:57.245715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c8ad-d1ce-4ce6-935c-9b97693164af None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:57.280781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88086-fc00-44a9-a05e-f63849104ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:57.281398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88086-fc00-44a9-a05e-f63849104ae5 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:57.281680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88086-fc00-44a9-a05e-f63849104ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:57.281959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88086-fc00-44a9-a05e-f63849104ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:57.282626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88086-fc00-44a9-a05e-f63849104ae5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:57.284130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88086-fc00-44a9-a05e-f63849104ae5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:57.376459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 21/46] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:32:57 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:32:59.000663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517256f2-70ba-4e37-a9d4-7071d9f8c314 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.001183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517256f2-70ba-4e37-a9d4-7071d9f8c314 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.001289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517256f2-70ba-4e37-a9d4-7071d9f8c314 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.002825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 26/47] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:59.007948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783fbcb-caaf-4361-af0f-cf54738dc154 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.008338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783fbcb-caaf-4361-af0f-cf54738dc154 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.008502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783fbcb-caaf-4361-af0f-cf54738dc154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.026383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e783fbcb-caaf-4361-af0f-cf54738dc154 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:59.027614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e783fbcb-caaf-4361-af0f-cf54738dc154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:59.093331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 22/48] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:32:59.295592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc0b62-cf97-4682-ad95-c441370de2e2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.295813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc0b62-cf97-4682-ad95-c441370de2e2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.296089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc0b62-cf97-4682-ad95-c441370de2e2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.297452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 27/49] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:32:59.302580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9185ab-735b-4d2e-9c90-e493936d9c78 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.302866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9185ab-735b-4d2e-9c90-e493936d9c78 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.303148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9185ab-735b-4d2e-9c90-e493936d9c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.320653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-cd9185ab-735b-4d2e-9c90-e493936d9c78 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:32:59.321832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cd9185ab-735b-4d2e-9c90-e493936d9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:32:59.345090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:59.365131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc0b62-cf97-4682-ad95-c441370de2e2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:59.390169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 23/50] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:32:59.475723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc0b62-cf97-4682-ad95-c441370de2e2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:59.499689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:59.510126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:59.510757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.511042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.511316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.521879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:32:59.526649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:32:59.527669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:32:59.528869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 28/51] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:32:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:32:59.534155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9185ab-735b-4d2e-9c90-e493936d9c78 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:59.634805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9185ab-735b-4d2e-9c90-e493936d9c78 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:59.660185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:59.668627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:59.669248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.669537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.669820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.670526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:32:59.670837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:59.672263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:59.680403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 24/52] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:32:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:32:59.685841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:59.708196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:59.762329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae30d8d-2d04-455c-920f-4f4e6643c945 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:59.786485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403eedd-017c-446b-acbb-c65648843e08 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:59.797579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:59.798376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.798665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.798947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.800118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:59.801637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:59.806196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 29/53] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:32:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:59.808747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:59.820715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:59.821348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.821635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.821912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] PATH_INFO: `/v3/users/2526f2a72f3a412d8bafb65717ad2b43` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.823162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] RBAC: Authorizing `identity:get_user(user_id=2526f2a72f3a412d8bafb65717ad2b43)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:59.824655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:59.826235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 25/54] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:32:59 2022] GET /identity/v3/users/2526f2a72f3a412d8bafb65717ad2b43 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:59.832292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:32:59.864035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:59.910988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fcbe-aaf4-413d-932f-31f9036af61b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:59.926608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:32:59.939101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc81ba-ae85-4cb5-a486-c71ad41f8930 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:32:59.944435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812f89-4e40-46ab-ad04-cef9cfbda942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:59.945070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812f89-4e40-46ab-ad04-cef9cfbda942 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.945401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812f89-4e40-46ab-ad04-cef9cfbda942 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.945733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812f89-4e40-46ab-ad04-cef9cfbda942 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.946373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812f89-4e40-46ab-ad04-cef9cfbda942 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:59.947858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812f89-4e40-46ab-ad04-cef9cfbda942 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:59.973936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:32:59.974569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:32:59.974853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:32:59.975129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:32:59.976351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:32:59.977803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:32:59.979730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 26/55] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:32:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:32:59.985536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:00.083391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 30/56] 10.222.0.62 () {60 vars in 1140 bytes} [Thu Aug 18 20:32:59 2022] POST /identity/v3/projects => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:33:00.095750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25b7a-5e3b-42c0-a371-58730aa9384b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:00.133867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1090e0a-b37a-4402-afcc-33c85b0a2bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:00.134493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090e0a-b37a-4402-afcc-33c85b0a2bed None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:00.134774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090e0a-b37a-4402-afcc-33c85b0a2bed None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:00.135048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090e0a-b37a-4402-afcc-33c85b0a2bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:00.135847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1090e0a-b37a-4402-afcc-33c85b0a2bed None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.domain.id=default, user.id=2526f2a72f3a412d8bafb65717ad2b43) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:00.136164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1090e0a-b37a-4402-afcc-33c85b0a2bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:00.137647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1090e0a-b37a-4402-afcc-33c85b0a2bed None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:00.146892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 27/57] 10.222.0.62 () {56 vars in 1322 bytes} [Thu Aug 18 20:32:59 2022] GET /identity/v3/role_assignments?user.id=2526f2a72f3a412d8bafb65717ad2b43&scope.domain.id=default&role.id=5eebc7f04cfc4979a378bf94830482af => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:01.988052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513dc00-f42e-400f-87f3-e5e0aca10d34 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:01.988612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513dc00-f42e-400f-87f3-e5e0aca10d34 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:01.988612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513dc00-f42e-400f-87f3-e5e0aca10d34 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:01.989964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 31/58] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:01.994950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3f44-8ccf-4281-9ab1-10f6c91833c7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:01.995318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3f44-8ccf-4281-9ab1-10f6c91833c7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:01.995662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3f44-8ccf-4281-9ab1-10f6c91833c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:02.013733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-612e3f44-8ccf-4281-9ab1-10f6c91833c7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:02.015766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-612e3f44-8ccf-4281-9ab1-10f6c91833c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:02.029226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:02.080753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 28/59] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:02.345647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513dc00-f42e-400f-87f3-e5e0aca10d34 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:02.446615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513dc00-f42e-400f-87f3-e5e0aca10d34 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:02.448912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:02.480402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f056f1a-b587-47a6-852e-8eba11d37224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:02.481034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f056f1a-b587-47a6-852e-8eba11d37224 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:02.481318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f056f1a-b587-47a6-852e-8eba11d37224 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:02.481595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f056f1a-b587-47a6-852e-8eba11d37224 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:02.482722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f056f1a-b587-47a6-852e-8eba11d37224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:02.484278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f056f1a-b587-47a6-852e-8eba11d37224 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:02.485850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 32/60] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:02.491487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e3f44-8ccf-4281-9ab1-10f6c91833c7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:02.587282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e3f44-8ccf-4281-9ab1-10f6c91833c7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:02.619739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c1417-358c-4291-8042-a6079b75fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:02.620276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c1417-358c-4291-8042-a6079b75fc63 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:02.620557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c1417-358c-4291-8042-a6079b75fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:02.620830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c1417-358c-4291-8042-a6079b75fc63 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:02.621469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c1417-358c-4291-8042-a6079b75fc63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:02.622908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c1417-358c-4291-8042-a6079b75fc63 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:02.721342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 29/61] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:02 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:05.871813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f263a9-8038-4dc9-bc9e-ca4a12379d5a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:05.872853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f263a9-8038-4dc9-bc9e-ca4a12379d5a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:05.873968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f263a9-8038-4dc9-bc9e-ca4a12379d5a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:05.875692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 33/62] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:05.882400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51fc2b-5d99-41fb-98e2-3565ce9e0e0b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:05.882846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51fc2b-5d99-41fb-98e2-3565ce9e0e0b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:05.882952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51fc2b-5d99-41fb-98e2-3565ce9e0e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:05.901461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:05.907671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8c51fc2b-5d99-41fb-98e2-3565ce9e0e0b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:05.908870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8c51fc2b-5d99-41fb-98e2-3565ce9e0e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:05.971027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710369f-76f6-474b-af8b-11cba6aa6448 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:05.971573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710369f-76f6-474b-af8b-11cba6aa6448 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:05.971998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710369f-76f6-474b-af8b-11cba6aa6448 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:05.973500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 34/63] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:05.978993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4cc13-aa96-4e56-bc54-bac231269f3a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:05.979272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4cc13-aa96-4e56-bc54-bac231269f3a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:05.979585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4cc13-aa96-4e56-bc54-bac231269f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:05.999764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-17f4cc13-aa96-4e56-bc54-bac231269f3a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:06.001444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-17f4cc13-aa96-4e56-bc54-bac231269f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:06.015196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 30/64] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:06.100616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 35/65] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:06.175830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc3fc-a54d-4e7d-9e92-fb6c1bfd96b5 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.176114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc3fc-a54d-4e7d-9e92-fb6c1bfd96b5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.176410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc3fc-a54d-4e7d-9e92-fb6c1bfd96b5 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.177841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 31/66] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:06.183646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653eb9-4e9e-4581-8ffb-0a0641e8b451 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.183965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653eb9-4e9e-4581-8ffb-0a0641e8b451 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.184222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653eb9-4e9e-4581-8ffb-0a0641e8b451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.215693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-79653eb9-4e9e-4581-8ffb-0a0641e8b451 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:06.217008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-79653eb9-4e9e-4581-8ffb-0a0641e8b451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:06.300074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7409-df97-462a-a83e-dddc41eb8f12 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.300384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7409-df97-462a-a83e-dddc41eb8f12 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.300642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7409-df97-462a-a83e-dddc41eb8f12 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.303874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 32/67] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:06.307738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63893-ab77-4a70-92af-728b8a242b9d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.308202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63893-ab77-4a70-92af-728b8a242b9d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.308743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63893-ab77-4a70-92af-728b8a242b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.321710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 36/68] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:06.344410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-07a63893-ab77-4a70-92af-728b8a242b9d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:06.345942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-07a63893-ab77-4a70-92af-728b8a242b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:06.392887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63cdd-8d25-48c3-a81e-109b29e4d416 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.393307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63cdd-8d25-48c3-a81e-109b29e4d416 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.393596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63cdd-8d25-48c3-a81e-109b29e4d416 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.394959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 37/69] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:06.400028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00f1d-ece5-4851-a39b-6d16c5235a66 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.400314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00f1d-ece5-4851-a39b-6d16c5235a66 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.400593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00f1d-ece5-4851-a39b-6d16c5235a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.432455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d1c00f1d-ece5-4851-a39b-6d16c5235a66 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:06.433973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d1c00f1d-ece5-4851-a39b-6d16c5235a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:06.439403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 33/70] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:06.445614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63893-ab77-4a70-92af-728b8a242b9d None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:06.478444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:06.515889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 38/71] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:06.516781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00f1d-ece5-4851-a39b-6d16c5235a66 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:06.517845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:06.586854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63893-ab77-4a70-92af-728b8a242b9d None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:06.640092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:06.641089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.641577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.642054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.653482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:06.659335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:06.660182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:06.660967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:06.663456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 34/72] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:06.664461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:06.669473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00f1d-ece5-4851-a39b-6d16c5235a66 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:06.710601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:06.711237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.711589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.711873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.725839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:06.731015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:06.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:06.732721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 39/73] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:06.733352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:06.760950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:06.837873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66cdfe-4c13-44e1-9af7-182a7a7bc974 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:06.871839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:06.872477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.872717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.872988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.873684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:06.873988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:06.875386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:06.878439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0856221-4e6a-4e97-85f9-19ed835b4ffd None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:06.886813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 40/74] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:06.887470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:06.905004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:06.913504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:06.914194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:06.914481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:06.914756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:06.924888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:06.930089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:06.931047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:06.931911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 35/75] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:06.932536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:06.972421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:06.988423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be00dd-c34f-4ec3-b562-a74f5a4fde53 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.022039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.022641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.022954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.023194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.023895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:07.024203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.025555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.034025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 41/76] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:07.036292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.039443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf14fc-90b0-4514-8e0d-536e8e0d62c0 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.074043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.074685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.074973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.075256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.076933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.078435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.084574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 36/77] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:07.084574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.136071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:07.136272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd8c4d-602a-4e02-bf72-3536bfb4e125 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.171017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.171676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.171964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.172241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.181106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128bd0-d39a-41b6-b1bc-e1311d2cbd15 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.182448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:07.187762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:07.188680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:07.189629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 42/78] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:07.190848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.199867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:07.214324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.214958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.215241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.217610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] PATH_INFO: `/v3/users/2526f2a72f3a412d8bafb65717ad2b43` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.217610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] RBAC: Authorizing `identity:get_user(user_id=2526f2a72f3a412d8bafb65717ad2b43)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.218695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.220309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 37/79] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/users/2526f2a72f3a412d8bafb65717ad2b43 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:07.221065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.291009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27aafa3-7d1b-4e94-afd3-f810a999bb09 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.317867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251a28-c39e-4a6e-8bcb-3ad0778663f0 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.326099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.326742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.327036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.327318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.328030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:07.328342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.329744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.337745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 43/80] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:07.338515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.345925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:07.352931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.353578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.360847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.360847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.369890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.371390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.373042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 38/81] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:07.374313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.410145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:07.444477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e975c-32f8-4e55-b661-64f43ac88854 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.473897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df24af-8b87-4d2b-b309-fa8aa3b39013 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.479071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.479719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.480006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.480283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.480932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.482382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.507819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.512397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.512397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.512397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.512397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:07.512397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.512397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.519474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 39/82] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:07.520333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.568219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:07.590787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 44/83] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:07 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:07.591783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.629467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250e7c2-5822-40c3-a850-4309f92ccd48 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.668536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.669169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.669450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.669723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.717060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b6838-9c3a-4ddd-9c4c-c28b9c460a4b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.746370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:07.752712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.754221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.763132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.764122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.764497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.764694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:07.766170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:07.767402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:07.769156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 45/84] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:07.769790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.803637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:07.873642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 40/85] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:07.874790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:07.900147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f202b7-9cdc-4fe7-9500-c55e26dac0c6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:07.944133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:07.944911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:07.945303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:07.945662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:08.004295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f21c-94f6-45ea-8daf-8aff5d6f375d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.016277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.027536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:08.032641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:08.051794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:08.052675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:08.053634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:08.054059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:08.055710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:08.058245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:08.061244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 41/86] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:08.066917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:08.083603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.156891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 46/87] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:08.157848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:08.196758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f36c9-aac1-49ed-b469-d7de610b482a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.248914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:08.249553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:08.249840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:08.250125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:08.269607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.278733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860518-20c4-41a3-b422-45d3c87c5800 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.317012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:08.317751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:08.318113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:08.318469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:08.319764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:08.321363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:08.328632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 47/88] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:08 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:08.329644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:08.351401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:08.351401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:08.367744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.462801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 42/89] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:08.464456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4710636-cb2b-4483-a6f0-dc0e6a012734 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.468412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:08.508997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:08.509681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:08.509976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:08.510408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:08.547382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.583406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c36a7-699a-4bb8-b94b-9c9d5f78a67a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.596383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.609456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:08.611354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:08.624361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:08.625169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:08.625637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:08.626016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:08.627333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:08.629432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:08.635702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 43/90] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:08 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:08.636663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:08.750342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 48/91] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:08.755219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd379c5-3731-4b80-8b4d-5941b0d997a1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.756608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:08.791084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:08.791861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:08.792217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:08.792574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:08.794088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=9eb915d3d58143368864175803663453, user.id=2526f2a72f3a412d8bafb65717ad2b43) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:08.795493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:08.797271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:08.803549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 44/92] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:08 2022] GET /identity/v3/role_assignments?user.id=2526f2a72f3a412d8bafb65717ad2b43&scope.project.id=9eb915d3d58143368864175803663453&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:08.809530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:08.835390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.875988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:08.908105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016c67a-7dde-4b33-af70-eadf66ddc69d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.944562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8ab8-ab54-4f47-a3b9-064fcae61a2b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:08.999351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:09.000851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.002802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.003255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.004538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, scope.project.id=9eb915d3d58143368864175803663453, user.id=740bcdcd97aa425ab9c8b2dd49a9a962) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:09.005071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:09.006415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:09.016453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 45/93] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:08 2022] GET /identity/v3/role_assignments?user.id=740bcdcd97aa425ab9c8b2dd49a9a962&scope.project.id=9eb915d3d58143368864175803663453&role.id=128a48837255468393c85bbc27310c38 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:09.017349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:09.041885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:09.042935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.043480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.044069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.048300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:09.050071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:09.052156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 49/94] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:08 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:09.072310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:09.156917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef482a-2012-4a02-a3b8-ea2dd7713f61 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:09.171946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:09.196017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:09.196379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.196586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.196877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] PATH_INFO: `/v3/projects/5cdbfbecb03c4e2a9408565e62905526` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.198167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] RBAC: Authorizing `identity:get_project(project_id=5cdbfbecb03c4e2a9408565e62905526)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:09.199772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:09.202581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 46/95] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:09 2022] GET /identity/v3/projects/5cdbfbecb03c4e2a9408565e62905526 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:09.211386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:09.249108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4f462-6ebe-4025-b1c5-6e665a28da9f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:09.299707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:09.311114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db445dd-870e-440a-a188-9e8a6bc3ed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:09.312135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db445dd-870e-440a-a188-9e8a6bc3ed29 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.312621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db445dd-870e-440a-a188-9e8a6bc3ed29 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.313093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db445dd-870e-440a-a188-9e8a6bc3ed29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.314064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db445dd-870e-440a-a188-9e8a6bc3ed29 None admin] RBAC: Adding query filter params (role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=9eb915d3d58143368864175803663453, user.id=740bcdcd97aa425ab9c8b2dd49a9a962) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:09.314582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db445dd-870e-440a-a188-9e8a6bc3ed29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:09.316391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db445dd-870e-440a-a188-9e8a6bc3ed29 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:09.331750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 50/96] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:09 2022] GET /identity/v3/role_assignments?user.id=740bcdcd97aa425ab9c8b2dd49a9a962&scope.project.id=9eb915d3d58143368864175803663453&role.id=f84356f9eb7648808591d233bb604d18 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:09.340770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918042d7-5166-4a17-80e3-69edcba11887 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:09.399583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e38fbf-beaa-45af-ab1a-31dc0f636d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:09.400501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e38fbf-beaa-45af-ab1a-31dc0f636d21 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.400983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e38fbf-beaa-45af-ab1a-31dc0f636d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.401471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e38fbf-beaa-45af-ab1a-31dc0f636d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.402517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e38fbf-beaa-45af-ab1a-31dc0f636d21 None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, scope.project.id=5cdbfbecb03c4e2a9408565e62905526, user.id=740bcdcd97aa425ab9c8b2dd49a9a962) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:09.403006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e38fbf-beaa-45af-ab1a-31dc0f636d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:09.404791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e38fbf-beaa-45af-ab1a-31dc0f636d21 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:09.411468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 47/97] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:09 2022] GET /identity/v3/role_assignments?user.id=740bcdcd97aa425ab9c8b2dd49a9a962&scope.project.id=5cdbfbecb03c4e2a9408565e62905526&role.id=128a48837255468393c85bbc27310c38 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:09.867170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d714bf-063f-4f3a-80cc-df276c4856d4 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.867597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d714bf-063f-4f3a-80cc-df276c4856d4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.867916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d714bf-063f-4f3a-80cc-df276c4856d4 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.869294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 51/98] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:09.885401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4369-78af-4a1c-8fab-f60bcec7039c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.885698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4369-78af-4a1c-8fab-f60bcec7039c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.885983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4369-78af-4a1c-8fab-f60bcec7039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.889440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967769-d843-4836-b71d-5952220a0fc4 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.889728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967769-d843-4836-b71d-5952220a0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.890010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967769-d843-4836-b71d-5952220a0fc4 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.891395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 52/99] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:09.897338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6951d-ef5e-4356-bccf-2c9dd061cce0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:09.897627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6951d-ef5e-4356-bccf-2c9dd061cce0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:09.897911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6951d-ef5e-4356-bccf-2c9dd061cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:09.925530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ccba4369-78af-4a1c-8fab-f60bcec7039c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:09.926759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ccba4369-78af-4a1c-8fab-f60bcec7039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:09.937403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8eb6951d-ef5e-4356-bccf-2c9dd061cce0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:09.938608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8eb6951d-ef5e-4356-bccf-2c9dd061cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:09.982319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:10.026661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 48/100] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:10.046115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 53/101] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:10.369365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba4369-78af-4a1c-8fab-f60bcec7039c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:10.482792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba4369-78af-4a1c-8fab-f60bcec7039c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:10.521867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:10.522530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:10.522816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:10.523095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:10.536065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:10.540959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:10.541775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:10.542537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 49/102] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:10.548487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6951d-ef5e-4356-bccf-2c9dd061cce0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:10.583388 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:10.628509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:10.704217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6951d-ef5e-4356-bccf-2c9dd061cce0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:10.718599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572e3-1755-42db-941e-618e86816b10 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:10.744717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:10.757468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:10.758158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:10.758443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:10.763391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:10.763391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:10.763391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:10.763391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 50/103] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:10.768080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:10.768963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:10.769450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:10.769746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:10.770165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:10.773322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:10.773920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:10.775558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:10.785855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 54/104] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:10.796917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:10.875178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:10.881069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ea4e-1db2-4c12-8656-d65444a24df6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:10.916502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:10.917124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:10.917463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:10.917687 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:10.918566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:10.920028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:10.927738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202d662-60cf-4309-926e-81ced35ee499 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:11.002779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:11.003465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:11.003736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:11.004013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] PATH_INFO: `/v3/users/19e82661ec3143908b4a5bb6aa3bb18d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:11.022259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] RBAC: Authorizing `identity:get_user(user_id=19e82661ec3143908b4a5bb6aa3bb18d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:11.023770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:11.027473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 55/105] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:10 2022] GET /identity/v3/users/19e82661ec3143908b4a5bb6aa3bb18d => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:11.031003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:11.040158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 51/106] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:33:10 2022] POST /identity/v3/projects => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:11.081447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:11.158046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781055f5-540f-4f52-8d81-c810aae5a467 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:11.209610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:11.210230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:11.210510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:11.210781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:11.305701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:11.307185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:11.364749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:11.446903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 56/107] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:11.453137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:11.588220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13c12-0629-4347-a59e-5380bb69fe5b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:11.635907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffd517-4ce5-4635-a0d6-e5e4878ab760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:11.636908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffd517-4ce5-4635-a0d6-e5e4878ab760 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:11.637391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffd517-4ce5-4635-a0d6-e5e4878ab760 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:11.637865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffd517-4ce5-4635-a0d6-e5e4878ab760 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:11.640437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffd517-4ce5-4635-a0d6-e5e4878ab760 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:11.642156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffd517-4ce5-4635-a0d6-e5e4878ab760 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:11.644069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 52/108] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:11 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:11.650097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:11.793304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac1f72-6e6a-48a4-bc60-6a9edc975a6e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:11.834899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf4b71-e4df-4f52-9ec2-bd6341ea9bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:11.835551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4b71-e4df-4f52-9ec2-bd6341ea9bad None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:11.835841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4b71-e4df-4f52-9ec2-bd6341ea9bad None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:11.836117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4b71-e4df-4f52-9ec2-bd6341ea9bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:11.836866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4b71-e4df-4f52-9ec2-bd6341ea9bad None admin] RBAC: Adding query filter params (role.id=94d0c05b1d80413ea118bcce4ed86faf, scope.project.id=9eb915d3d58143368864175803663453, user.id=19e82661ec3143908b4a5bb6aa3bb18d) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:11.837180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4b71-e4df-4f52-9ec2-bd6341ea9bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:11.838633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4b71-e4df-4f52-9ec2-bd6341ea9bad None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:11.844958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 57/109] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:11 2022] GET /identity/v3/role_assignments?user.id=19e82661ec3143908b4a5bb6aa3bb18d&scope.project.id=9eb915d3d58143368864175803663453&role.id=94d0c05b1d80413ea118bcce4ed86faf => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:12.089332 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a97d-2e14-4131-b593-8e30381d839e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.090310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a97d-2e14-4131-b593-8e30381d839e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.090800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a97d-2e14-4131-b593-8e30381d839e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.092464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 53/110] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:12.098378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a5e6-c991-43e9-a081-40e5efc9fbb8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.098853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a5e6-c991-43e9-a081-40e5efc9fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.098925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a5e6-c991-43e9-a081-40e5efc9fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.117684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:12.128444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d398a5e6-c991-43e9-a081-40e5efc9fbb8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:12.129671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d398a5e6-c991-43e9-a081-40e5efc9fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:12.218635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 58/111] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:12.247915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f1f3-98de-4a14-b4a8-aa0441630917 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.248994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f1f3-98de-4a14-b4a8-aa0441630917 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.249486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f1f3-98de-4a14-b4a8-aa0441630917 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.251089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 54/112] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:12.257207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f6687-e9df-49f1-9839-bb77dd70afc2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.257781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f6687-e9df-49f1-9839-bb77dd70afc2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.258298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f6687-e9df-49f1-9839-bb77dd70afc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.278325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-832f6687-e9df-49f1-9839-bb77dd70afc2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:12.279913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-832f6687-e9df-49f1-9839-bb77dd70afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:12.293019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfa3d-383e-44ca-9fd9-ce6640589257 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.293610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfa3d-383e-44ca-9fd9-ce6640589257 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.294070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfa3d-383e-44ca-9fd9-ce6640589257 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.296179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 55/113] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:12.301763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0060d-ec6a-490f-b787-8bd7f5738024 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.302297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0060d-ec6a-490f-b787-8bd7f5738024 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.302757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0060d-ec6a-490f-b787-8bd7f5738024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.335198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6bd0060d-ec6a-490f-b787-8bd7f5738024 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:12.337531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6bd0060d-ec6a-490f-b787-8bd7f5738024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:12.387770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:12.455043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 59/114] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:12.460676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bbc76-f6fb-4643-b859-ec4b9bfb6fd7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.460974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bbc76-f6fb-4643-b859-ec4b9bfb6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.461260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bbc76-f6fb-4643-b859-ec4b9bfb6fd7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.462791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 60/115] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:12.470371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100784-65c0-4dad-afd9-b9f8909d3c3c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.470653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100784-65c0-4dad-afd9-b9f8909d3c3c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.470935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100784-65c0-4dad-afd9-b9f8909d3c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.502745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e4100784-65c0-4dad-afd9-b9f8909d3c3c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:12.503165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 56/116] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:12.504584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e4100784-65c0-4dad-afd9-b9f8909d3c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:12.582026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:12.591201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 61/117] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:12.629830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0060d-ec6a-490f-b787-8bd7f5738024 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:12.788454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0060d-ec6a-490f-b787-8bd7f5738024 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:12.833520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:12.834519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:12.835070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:12.835601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:12.852237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:12.857416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:12.858307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:12.859103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:12.863815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 57/118] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:12.865156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100784-65c0-4dad-afd9-b9f8909d3c3c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:12.871354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:12.892903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:13.000753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046a29a-550e-42c0-acc9-e28d46358c56 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.031564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100784-65c0-4dad-afd9-b9f8909d3c3c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.036942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.037605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.037957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.038280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.038957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:13.039372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:13.041015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:13.050195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 58/119] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:13.050891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.067279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.067947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.068233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.068513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.083383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:13.084321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:13.085354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 62/120] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:13.086274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.140302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:13.146781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:13.183053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6af7-001e-41ca-b8c5-78c483df09c8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.201628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e036e-8847-4d83-83f2-be0509bcf42a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.223536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.224468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.224850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.225520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.239997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:13.244478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.245394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.245827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:13.246251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:13.247224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:13.248052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:13.249188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.249292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 59/121] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:13.249292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.267591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:13.272986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:13.273854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:13.274774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 63/122] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:13.276427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.389192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd074e3-2150-4f7e-8744-68ee486262cc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.389427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e15f-a506-42d7-bf27-5de5253f461e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.420413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:13.424079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:13.427761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.428705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.429234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.429714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.430773 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:13.431282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:13.444907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.444907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.445150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:13.445233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.445233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] PATH_INFO: `/v3/users/2526f2a72f3a412d8bafb65717ad2b43` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.445233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=2526f2a72f3a412d8bafb65717ad2b43)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:13.445233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:13.445233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 60/123] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/users/2526f2a72f3a412d8bafb65717ad2b43 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:13.445233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.445616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 64/124] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:13.445616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.555846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bffdc-9726-48f3-9458-ad0b3c774fc2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.586866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb6894-c309-4c7b-bf4d-08950b545c91 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.602083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.603606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.604193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.604650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.605800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:13.606728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:13.608369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:13.620700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 61/125] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:13.622099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.627526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.628756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.629419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.629976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.631489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:13.632170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:13.635335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:13.657479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 65/126] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:13.660617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.713746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:13.722599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:13.789450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131d4c4-4cae-48a8-9962-351a21ad45d2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.802805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1831bc9-44ea-4f56-a03e-03b57a9ff122 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.833742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.834708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.835557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.836076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.837467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:13.839126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:13.842155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 62/127] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:13.843456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.865239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:13.866434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:13.867050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:13.867731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:13.869726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:13.872612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:13.876720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 66/128] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:13.878274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:13.964811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57fa0-1cc2-4f8b-9c3a-911719a5df33 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:13.993377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:14.004345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.005357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.005802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.009481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.009481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.009481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.011216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 63/129] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:14.012413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:14.033397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5f0ef-1987-4513-8eae-c79052f37e08 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.042778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:14.068788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.069451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.069736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.070013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.071259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.072936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.074644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 67/130] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:13 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:14.075305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:14.137699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b96db-811f-4744-9a37-369a747b8358 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.173124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.173791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.174077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.174355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453/users/2526f2a72f3a412d8bafb65717ad2b43/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.176298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] RBAC: Authorizing `identity:create_grant(project_id=9eb915d3d58143368864175803663453, user_id=2526f2a72f3a412d8bafb65717ad2b43, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.177746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.186879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a4ce-3aea-4a07-9bf3-49aac239978a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.221125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.221746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.222038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.222313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.223488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.224942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.226594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 68/131] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:14 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:14.227355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:14.245873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 64/132] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:14 2022] PUT /identity/v3/projects/9eb915d3d58143368864175803663453/users/2526f2a72f3a412d8bafb65717ad2b43/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:14.246759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:14.282713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:14.308970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:14.355051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf3c7-96ac-4fbb-ac78-9139abeebd69 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.380421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f2b4-f384-478a-a03f-3dd69c74ffff None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.397304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fbb39-df27-49f5-b5bc-fee6d43565d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.398164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fbb39-df27-49f5-b5bc-fee6d43565d1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.398515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fbb39-df27-49f5-b5bc-fee6d43565d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.398889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fbb39-df27-49f5-b5bc-fee6d43565d1 None admin] PATH_INFO: `/v3/projects/5cdbfbecb03c4e2a9408565e62905526` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.400398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fbb39-df27-49f5-b5bc-fee6d43565d1 None admin] RBAC: Authorizing `identity:get_project(project_id=5cdbfbecb03c4e2a9408565e62905526)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.402128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fbb39-df27-49f5-b5bc-fee6d43565d1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.404680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 69/133] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:14 2022] GET /identity/v3/projects/5cdbfbecb03c4e2a9408565e62905526 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:14.405969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda103e-6f96-4e62-a0c6-56ab70383861 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.406260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda103e-6f96-4e62-a0c6-56ab70383861 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.406540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda103e-6f96-4e62-a0c6-56ab70383861 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.407866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 70/134] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:14.408647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda103e-6f96-4e62-a0c6-56ab70383861 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:14.439316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.440060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.440355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.440704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.442008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.443763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.445748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 65/135] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:14 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:14.446760 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:14.537145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda103e-6f96-4e62-a0c6-56ab70383861 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.551663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:14.562298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70658f9-caa2-404d-8c63-5242a8c91aca None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.574646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e5ab-7b42-4292-a9d9-daa8b5e57da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.575325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e5ab-7b42-4292-a9d9-daa8b5e57da7 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.575673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e5ab-7b42-4292-a9d9-daa8b5e57da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.575983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e5ab-7b42-4292-a9d9-daa8b5e57da7 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453/users/740bcdcd97aa425ab9c8b2dd49a9a962/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.578065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5e5ab-7b42-4292-a9d9-daa8b5e57da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9eb915d3d58143368864175803663453, user_id=740bcdcd97aa425ab9c8b2dd49a9a962, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.579555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5e5ab-7b42-4292-a9d9-daa8b5e57da7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.587745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:14.607999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:14.608665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.608945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.609217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] PATH_INFO: `/v3/projects/5cdbfbecb03c4e2a9408565e62905526/users/740bcdcd97aa425ab9c8b2dd49a9a962/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.611336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] RBAC: Authorizing `identity:create_grant(project_id=5cdbfbecb03c4e2a9408565e62905526, user_id=740bcdcd97aa425ab9c8b2dd49a9a962, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:14.612927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:14.676880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 71/136] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:14 2022] PUT /identity/v3/projects/9eb915d3d58143368864175803663453/users/740bcdcd97aa425ab9c8b2dd49a9a962/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:14.685131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f768977-6be2-4e57-9e14-9213f40dc6c5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.685430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f768977-6be2-4e57-9e14-9213f40dc6c5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.685710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f768977-6be2-4e57-9e14-9213f40dc6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.706936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2f768977-6be2-4e57-9e14-9213f40dc6c5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:14.707476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 66/137] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:14 2022] PUT /identity/v3/projects/5cdbfbecb03c4e2a9408565e62905526/users/740bcdcd97aa425ab9c8b2dd49a9a962/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:14.717596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:14.718944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2f768977-6be2-4e57-9e14-9213f40dc6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:14.867407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 72/138] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:14.869006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ea2-3020-46dd-9b1e-e0ecdfb7609c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.869494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ea2-3020-46dd-9b1e-e0ecdfb7609c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.869967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ea2-3020-46dd-9b1e-e0ecdfb7609c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.872226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 73/139] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:14.878179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd273-4d3d-4488-93a0-056c8be2369e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:14.878179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd273-4d3d-4488-93a0-056c8be2369e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:14.878179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd273-4d3d-4488-93a0-056c8be2369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:14.907646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-59fdd273-4d3d-4488-93a0-056c8be2369e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:14.908855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-59fdd273-4d3d-4488-93a0-056c8be2369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:14.934249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b611-b22a-46c9-bed1-b91a75818fea None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:14.984624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 74/140] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:15.012898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:15.014346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:15.014630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:15.014908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453/users/740bcdcd97aa425ab9c8b2dd49a9a962/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:15.021152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] RBAC: Authorizing `identity:create_grant(project_id=9eb915d3d58143368864175803663453, user_id=740bcdcd97aa425ab9c8b2dd49a9a962, role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:15.022614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:15.111337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 67/141] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:14 2022] PUT /identity/v3/projects/9eb915d3d58143368864175803663453/users/740bcdcd97aa425ab9c8b2dd49a9a962/roles/f84356f9eb7648808591d233bb604d18 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:15.247227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd273-4d3d-4488-93a0-056c8be2369e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:15.278244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:15.290407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:15.346600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:15.429353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd273-4d3d-4488-93a0-056c8be2369e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:15.471155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:15.471946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:15.472227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:15.472504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:15.473705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:15.475259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:15.476888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 75/142] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:15.483075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:15.505601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef076a4-4222-4fea-bf3c-6814312aeb8a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:15.587440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc31b3c-efa3-4128-a25e-31caf5e5d7fc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:15.592210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:15.624616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:15.625228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:15.625509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:15.625784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:15.626520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:15.628138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:15.632947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:15.633608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:15.633997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:15.634363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:15.666339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:15.672659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:15.673534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:15.674279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 68/143] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:15.680686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:15.724815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 76/144] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:15 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:15.843218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b438000-5ef4-4924-a292-944efab90d4b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:15.844870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:15.882564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:15.883195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:15.883506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:15.883787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:15.884598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:15.884766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:15.886477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:15.897174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 69/145] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:15.903142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:16.028207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756f3c6-3ece-4d2e-8ecd-5a66e125f043 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:16.077920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:16.078683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:16.078974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:16.079251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] PATH_INFO: `/v3/users/19e82661ec3143908b4a5bb6aa3bb18d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:16.080846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] RBAC: Authorizing `identity:get_user(user_id=19e82661ec3143908b4a5bb6aa3bb18d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:16.082334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:16.083986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 77/146] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:15 2022] GET /identity/v3/users/19e82661ec3143908b4a5bb6aa3bb18d => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:16.093712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:16.215355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8ac9-d4c1-4eef-ae27-c402f2dc4a98 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:16.265721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b4f5d-d200-415f-8aad-ff58f2639436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:16.266373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b4f5d-d200-415f-8aad-ff58f2639436 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:16.266660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b4f5d-d200-415f-8aad-ff58f2639436 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:16.266938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b4f5d-d200-415f-8aad-ff58f2639436 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:16.268117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b4f5d-d200-415f-8aad-ff58f2639436 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:16.269580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b4f5d-d200-415f-8aad-ff58f2639436 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:16.271441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 70/147] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:16 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:16.277449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:16.306933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:16.424552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1bf1-154e-4907-8efc-b3f7c8af07fd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:16.474531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1127b3-31f3-4703-b528-5e53d4fd683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:16.475210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1127b3-31f3-4703-b528-5e53d4fd683c None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:16.475527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1127b3-31f3-4703-b528-5e53d4fd683c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:16.475800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1127b3-31f3-4703-b528-5e53d4fd683c None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453/users/19e82661ec3143908b4a5bb6aa3bb18d/roles/94d0c05b1d80413ea118bcce4ed86faf` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:16.477780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1127b3-31f3-4703-b528-5e53d4fd683c None admin] RBAC: Authorizing `identity:create_grant(project_id=9eb915d3d58143368864175803663453, user_id=19e82661ec3143908b4a5bb6aa3bb18d, role_id=94d0c05b1d80413ea118bcce4ed86faf)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:16.479258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1127b3-31f3-4703-b528-5e53d4fd683c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:16.574368 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 78/148] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:16 2022] PUT /identity/v3/projects/9eb915d3d58143368864175803663453/users/19e82661ec3143908b4a5bb6aa3bb18d/roles/94d0c05b1d80413ea118bcce4ed86faf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:16.792951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb59e-6fce-4be1-9b71-1e7e9920cf3d None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:16.793487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb59e-6fce-4be1-9b71-1e7e9920cf3d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:16.793487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb59e-6fce-4be1-9b71-1e7e9920cf3d None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:16.795572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 71/149] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:16.800811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cececfe4-acc3-4c5c-8b6d-c071d3f00697 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:16.801100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cececfe4-acc3-4c5c-8b6d-c071d3f00697 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:16.801382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cececfe4-acc3-4c5c-8b6d-c071d3f00697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:16.825896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-cececfe4-acc3-4c5c-8b6d-c071d3f00697 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:16.827113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cececfe4-acc3-4c5c-8b6d-c071d3f00697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:16.912908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 79/150] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:17.428211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb59e-6fce-4be1-9b71-1e7e9920cf3d None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:17.468761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:17.531651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac73f03-63bb-4f80-b9c3-a6b5c679d60c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.532529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac73f03-63bb-4f80-b9c3-a6b5c679d60c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.532981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac73f03-63bb-4f80-b9c3-a6b5c679d60c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.539479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 80/151] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:17.544250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb59e-6fce-4be1-9b71-1e7e9920cf3d None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:17.552856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0cdad-a093-4d84-82cc-ba52bdd3112e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.553459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0cdad-a093-4d84-82cc-ba52bdd3112e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.553953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0cdad-a093-4d84-82cc-ba52bdd3112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.592959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bcb0cdad-a093-4d84-82cc-ba52bdd3112e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:17.594710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bcb0cdad-a093-4d84-82cc-ba52bdd3112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:17.597666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:17.598583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.599080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.599579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.622324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:17.629651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:17.636416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:17.639210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:17.640082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 72/152] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:17.668471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:17.776708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 81/153] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:17.800396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d938-6c08-41c1-9a07-65d7b74e06a1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.800937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d938-6c08-41c1-9a07-65d7b74e06a1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.801384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d938-6c08-41c1-9a07-65d7b74e06a1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.802900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 82/154] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:17.813472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aeb7e-3ced-465f-b9c8-f7f8d65357e9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.813965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aeb7e-3ced-465f-b9c8-f7f8d65357e9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.814401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aeb7e-3ced-465f-b9c8-f7f8d65357e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.849109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d26aeb7e-3ced-465f-b9c8-f7f8d65357e9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:17.850588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d26aeb7e-3ced-465f-b9c8-f7f8d65357e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:17.891166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:17.914208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e03ce1-54cf-4764-ae40-e864f5469639 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:17.961308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 83/155] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:17.985982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:17.986602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:17.986926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:17.987201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:17.987958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:17.988261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:17.995715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:18.011878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 73/156] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:18.020498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aeb7e-3ced-465f-b9c8-f7f8d65357e9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.118696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:18.149648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aeb7e-3ced-465f-b9c8-f7f8d65357e9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:18.194283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:18.194931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:18.195217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:18.195523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] PATH_INFO: `/v3/users/2526f2a72f3a412d8bafb65717ad2b43` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:18.200071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] RBAC: Authorizing `identity:get_user(user_id=2526f2a72f3a412d8bafb65717ad2b43)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:18.201722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:18.203582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 84/157] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/users/2526f2a72f3a412d8bafb65717ad2b43 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:18.209389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.331550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534c991-0483-4cfc-9d3b-f1f88711cc43 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:18.366514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:18.367130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:18.367429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:18.367704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:18.393152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:18.438455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:18.439971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:18.456446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.543348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 74/158] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:18.554254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.647727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:18.684538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc5bd9-0c26-433a-ba2e-9ee8f9fac1a2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:18.724536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:18.725094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:18.725368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:18.725641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:18.726974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:18.728822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:18.730644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 75/159] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:18.731714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.740400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd316cb-f076-48fa-9f75-6f39f2558130 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:18.849512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493fc01-f45d-46ea-8089-b1d6d793187a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:18.882081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:18.882733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:18.883022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:18.883293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:18.886381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:18.887203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:18.887696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:18.888954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:18.894535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:18.906530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:18.914334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:18.915393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:18.916259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:18.918446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 76/160] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:18.919642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.919889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:18.929152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:18.930302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 85/161] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:18.931217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:18.939913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:19.065710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff985ea-1d5a-4881-a49e-297d91dadf58 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.117458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.118354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.118791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.119216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.120115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=9eb915d3d58143368864175803663453, user.id=2526f2a72f3a412d8bafb65717ad2b43) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:19.120831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:19.122963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:19.132631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 77/162] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/role_assignments?user.id=2526f2a72f3a412d8bafb65717ad2b43&scope.project.id=9eb915d3d58143368864175803663453&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:19.133819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:19.259781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:19.279931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a27da9-a3eb-4b79-8df3-bfde44d0211a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.288513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fdfa2-7ef9-465d-aa50-9cc7a5ae3261 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.332392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d3a4f-d748-47b4-b9e1-83dd86cece24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.332926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3a4f-d748-47b4-b9e1-83dd86cece24 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.333293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3a4f-d748-47b4-b9e1-83dd86cece24 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.333472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3a4f-d748-47b4-b9e1-83dd86cece24 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.334396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3a4f-d748-47b4-b9e1-83dd86cece24 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:19.334499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3a4f-d748-47b4-b9e1-83dd86cece24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:19.335980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3a4f-d748-47b4-b9e1-83dd86cece24 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:19.350598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 86/163] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:19.356898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024094-2db6-4389-94bf-641289c817a0 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.358102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024094-2db6-4389-94bf-641289c817a0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.358378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024094-2db6-4389-94bf-641289c817a0 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.359791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 87/164] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:19.360697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c024094-2db6-4389-94bf-641289c817a0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:19.408813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bb4a1-ca33-4a1c-b9fe-8d754595f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.409452 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb4a1-ca33-4a1c-b9fe-8d754595f338 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.409761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb4a1-ca33-4a1c-b9fe-8d754595f338 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.410042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb4a1-ca33-4a1c-b9fe-8d754595f338 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.410740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bb4a1-ca33-4a1c-b9fe-8d754595f338 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:19.411047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bb4a1-ca33-4a1c-b9fe-8d754595f338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:19.412505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bb4a1-ca33-4a1c-b9fe-8d754595f338 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:19.441322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 78/165] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:19.442600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8222f-9e8b-4f3b-98d3-e473cff7a238 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.442887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8222f-9e8b-4f3b-98d3-e473cff7a238 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.443166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8222f-9e8b-4f3b-98d3-e473cff7a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.462930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:19.473918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-81c8222f-9e8b-4f3b-98d3-e473cff7a238 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:19.475174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-81c8222f-9e8b-4f3b-98d3-e473cff7a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:19.547919 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c024094-2db6-4389-94bf-641289c817a0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.601273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 79/166] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:19.602077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8222f-9e8b-4f3b-98d3-e473cff7a238 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:19.624213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.624864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.625144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.625418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.629046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:19.630496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:19.632141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 88/167] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:19 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:19.641749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:19.703890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:19.806497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8222f-9e8b-4f3b-98d3-e473cff7a238 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.855081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.855674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.855953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.856224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:19.857402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:19.858977 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:19.860802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 80/168] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:19 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:19.866253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:19.890344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e55bab-11d8-4284-b13f-a9cf72d3f578 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:19.966883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:19.981446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:19.982114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:19.984946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:19.984946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.064307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb57b9e-4dcb-4405-8d29-d9cd25975ffc None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:20.091721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:20.140844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:20.142263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:20.153094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599463e6-d2c2-4bf6-bd22-b7298706baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:20.154080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599463e6-d2c2-4bf6-bd22-b7298706baad None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.154571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599463e6-d2c2-4bf6-bd22-b7298706baad None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.155030 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599463e6-d2c2-4bf6-bd22-b7298706baad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.238546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599463e6-d2c2-4bf6-bd22-b7298706baad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:20.240903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599463e6-d2c2-4bf6-bd22-b7298706baad None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:20.359879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 81/169] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:20.361535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2267-36eb-4cc4-9114-55af66f72931 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.366285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2267-36eb-4cc4-9114-55af66f72931 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.366960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2267-36eb-4cc4-9114-55af66f72931 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.368817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 82/170] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:20.370225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd2267-36eb-4cc4-9114-55af66f72931 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:20.380520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:20.398357 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 89/171] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:20.399401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:20.469152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:20.503016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd2267-36eb-4cc4-9114-55af66f72931 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:20.539465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c994c-f291-4a9c-ad71-d225a8875d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:20.540099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c994c-f291-4a9c-ad71-d225a8875d44 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.540403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c994c-f291-4a9c-ad71-d225a8875d44 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.540712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c994c-f291-4a9c-ad71-d225a8875d44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.552295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c994c-f291-4a9c-ad71-d225a8875d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-2e6c994c-f291-4a9c-ad71-d225a8875d44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:20.557150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:20.558370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:20.559144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 83/172] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:20.562927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211e8e-9b37-4559-9597-0697042a219d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.563270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211e8e-9b37-4559-9597-0697042a219d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.563589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211e8e-9b37-4559-9597-0697042a219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.569874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bab9f-0588-4f7f-b909-03178d8e7a6a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:20.588416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d9211e8e-9b37-4559-9597-0697042a219d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:20.590161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d9211e8e-9b37-4559-9597-0697042a219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:20.612501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:20.613799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.614367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.614772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] PATH_INFO: `/v3/projects/5cdbfbecb03c4e2a9408565e62905526` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.616016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] RBAC: Authorizing `identity:get_project(project_id=5cdbfbecb03c4e2a9408565e62905526)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:20.618132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:20.624791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 90/173] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:20 2022] GET /identity/v3/projects/5cdbfbecb03c4e2a9408565e62905526 => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:20.624791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:20.663333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:20.678852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 84/174] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:20.678852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27318-2368-4192-95dd-bd1006bbd4f9 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.678852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27318-2368-4192-95dd-bd1006bbd4f9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.678852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27318-2368-4192-95dd-bd1006bbd4f9 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.678852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 85/175] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:20.680028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b6a6-cf7d-419c-87db-be2e3e889d5b None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.681675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b6a6-cf7d-419c-87db-be2e3e889d5b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.681961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b6a6-cf7d-419c-87db-be2e3e889d5b None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.683352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 86/176] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:20.688193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26b6a6-cf7d-419c-87db-be2e3e889d5b None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:20.749285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:20.752336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da5bd6-5640-4215-9a69-85d61a645e08 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:20.787707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:20.788829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.789167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.789449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.791016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:20.793117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:20.796075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 91/177] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:20 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:20.800256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:20.807496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26b6a6-cf7d-419c-87db-be2e3e889d5b None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:20.840705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d383aa5-302c-4ae4-9d9e-c571200c175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:20.841835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383aa5-302c-4ae4-9d9e-c571200c175e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.842109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383aa5-302c-4ae4-9d9e-c571200c175e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.842375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383aa5-302c-4ae4-9d9e-c571200c175e None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.843038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d383aa5-302c-4ae4-9d9e-c571200c175e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:20.843338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d383aa5-302c-4ae4-9d9e-c571200c175e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:20.844730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d383aa5-302c-4ae4-9d9e-c571200c175e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:20.852746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 87/178] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:20.853891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781108a4-2532-4aad-88c3-af0d2178a5c5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.854171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781108a4-2532-4aad-88c3-af0d2178a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.854443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781108a4-2532-4aad-88c3-af0d2178a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.877953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-781108a4-2532-4aad-88c3-af0d2178a5c5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:20.879200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-781108a4-2532-4aad-88c3-af0d2178a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:20.922656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd54055-de42-407e-8c4e-4a7929a34841 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:20.950287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:20.964219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 88/179] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:20.965507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07e148-cca1-43a7-9465-657a619a5c3f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.965851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07e148-cca1-43a7-9465-657a619a5c3f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.968511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07e148-cca1-43a7-9465-657a619a5c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.976396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853d13-a7dc-4ade-a0e8-85fae995bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:20.977010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853d13-a7dc-4ade-a0e8-85fae995bb71 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.977290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853d13-a7dc-4ade-a0e8-85fae995bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.977561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853d13-a7dc-4ade-a0e8-85fae995bb71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.978300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853d13-a7dc-4ade-a0e8-85fae995bb71 None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, scope.project.id=5cdbfbecb03c4e2a9408565e62905526, user.id=740bcdcd97aa425ab9c8b2dd49a9a962) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:20.978611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853d13-a7dc-4ade-a0e8-85fae995bb71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:20.980075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853d13-a7dc-4ade-a0e8-85fae995bb71 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:20.986059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 92/180] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:20 2022] GET /identity/v3/role_assignments?user.id=740bcdcd97aa425ab9c8b2dd49a9a962&scope.project.id=5cdbfbecb03c4e2a9408565e62905526&role.id=128a48837255468393c85bbc27310c38 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:20.986059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0821-02ef-4f33-817c-612967ca51a9 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:20.986059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0821-02ef-4f33-817c-612967ca51a9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:20.986059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0821-02ef-4f33-817c-612967ca51a9 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:20.986059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 93/181] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:20.986059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d0821-02ef-4f33-817c-612967ca51a9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:20.998454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fe07e148-cca1-43a7-9465-657a619a5c3f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:20.999988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fe07e148-cca1-43a7-9465-657a619a5c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:21.042253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:21.100303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 89/182] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:21.107988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07e148-cca1-43a7-9465-657a619a5c3f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.159649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d0821-02ef-4f33-817c-612967ca51a9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.205005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.205718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.206103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.206480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.207322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, scope.project.id=9eb915d3d58143368864175803663453, user.id=740bcdcd97aa425ab9c8b2dd49a9a962) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:21.207766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:21.209346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:21.216664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 94/183] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:20 2022] GET /identity/v3/role_assignments?user.id=740bcdcd97aa425ab9c8b2dd49a9a962&scope.project.id=9eb915d3d58143368864175803663453&role.id=128a48837255468393c85bbc27310c38 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:21.217665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.225304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07e148-cca1-43a7-9465-657a619a5c3f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.250407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:21.270817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ca8a5-aba8-40cd-bfca-7777a143e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.271523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca8a5-aba8-40cd-bfca-7777a143e18f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.271955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca8a5-aba8-40cd-bfca-7777a143e18f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.272232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca8a5-aba8-40cd-bfca-7777a143e18f None admin] PATH_INFO: `/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.273533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ca8a5-aba8-40cd-bfca-7777a143e18f None admin] RBAC: Authorizing `identity:get_user(user_id=740bcdcd97aa425ab9c8b2dd49a9a962)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:21.275558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ca8a5-aba8-40cd-bfca-7777a143e18f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:21.277635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 90/184] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/users/740bcdcd97aa425ab9c8b2dd49a9a962 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:21.279511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d66e7-3bae-4ce6-98de-2cb833bedaa9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.279809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d66e7-3bae-4ce6-98de-2cb833bedaa9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.280134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d66e7-3bae-4ce6-98de-2cb833bedaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.302856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ab8d66e7-3bae-4ce6-98de-2cb833bedaa9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:21.304195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ab8d66e7-3bae-4ce6-98de-2cb833bedaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:21.352913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:21.360053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310baf83-6dde-43b8-aa56-a5413a02f0ef None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.411841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 91/185] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:21.420619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.421275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.421557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.421832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.422812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d66e7-3bae-4ce6-98de-2cb833bedaa9 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.444028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:21.450247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:21.451871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:21.452683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 95/186] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:21.453380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.557303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d66e7-3bae-4ce6-98de-2cb833bedaa9 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.579627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:21.586157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad71f-529b-4c27-b183-5ee14830b969 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.598047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.598726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.598997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.599264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.614540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:21.619749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:21.620775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:21.621615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 92/187] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:21.623317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.636285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.636910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.637198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.637470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.665200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:21.711352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:21.712951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:21.730205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6542f59-a92e-40e6-835f-bb02340df523 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.765600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.766204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.766513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.766789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.767500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:21.767808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:21.769187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:21.777307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 93/188] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:21.778180 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.818996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:21.821275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 96/189] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:21.822189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.879853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:21.880037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cef3ef-ebc4-487d-96ce-ea937edb73e3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.913684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.914313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.914596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.914873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.924514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793000b-a39a-434e-9d72-595e4bda3b00 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:21.925596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:21.930840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:21.931976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 94/190] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:21.932994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:21.976053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:21.977181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:21.977658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:21.978155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:21.979324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:21.979880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:21.982914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:21.992433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 97/191] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:21.992433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.048296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:22.053218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08fc9f-39cd-4557-a1fb-8574346f9105 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.088361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.088924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.089199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.089471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.090614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.092672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.094376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 95/192] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:22.095128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.112004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e8c2-c6be-4410-903a-246f85a4b354 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.128941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:22.145563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.146199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.146478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.146751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] PATH_INFO: `/v3/users/19e82661ec3143908b4a5bb6aa3bb18d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.147901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] RBAC: Authorizing `identity:get_user(user_id=19e82661ec3143908b4a5bb6aa3bb18d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.149348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.150936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 98/193] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:21 2022] GET /identity/v3/users/19e82661ec3143908b4a5bb6aa3bb18d => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:22.151750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.194397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405dcd6-13d5-4ba7-97c0-07a6d52c5de4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.227235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.227895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.228180 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.228456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.229601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.231044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.233291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 96/194] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:22.234053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.257336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f3ee6-570d-4800-aba5-c41352d6fc09 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.270090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:22.292082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.292715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.292998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.293274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.293944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:22.294802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.296245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.304880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 99/195] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:22.308278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.347834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271de64-2be1-4af5-a6b0-06cf0782c675 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.362175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:22.382238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.383984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.383984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.383984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] PATH_INFO: `/v3/users/18f31a1c96ee4b1db0ad48ba98855581` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.410921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] RBAC: Authorizing `identity:get_user(user_id=18f31a1c96ee4b1db0ad48ba98855581)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.413568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.415495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 97/196] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/users/18f31a1c96ee4b1db0ad48ba98855581 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:22.416282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.422331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32fd37-8f37-475f-8c06-ea95ab69c9df None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.455509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.456115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.456391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.456658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.457307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.458734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.506464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:22.515382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17060-f1a1-4409-9c64-f4e878c2628e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.548187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.548790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.549119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.549393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.561225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 100/197] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:22 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:22.561985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.633613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.635029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.705957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fcace-b7f7-462a-bb0b-01a9322ef4f6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.710088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:22.752873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.753197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.753432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.753705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.754447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] RBAC: Adding query filter params (role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=9eb915d3d58143368864175803663453, user.id=740bcdcd97aa425ab9c8b2dd49a9a962) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:22.754816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.757030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.767175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 101/198] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/role_assignments?user.id=740bcdcd97aa425ab9c8b2dd49a9a962&scope.project.id=9eb915d3d58143368864175803663453&role.id=f84356f9eb7648808591d233bb604d18 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:22.768655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.780989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:22.791427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 98/199] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:22.792643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.917764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8a6a-5e79-4969-8255-27cddc495477 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.929393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8cdaf-7db8-453e-9737-c6ef2dd3d723 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:22.966825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.968886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.968886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.968886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] PATH_INFO: `/v3/users/18f31a1c96ee4b1db0ad48ba98855581` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:22.970001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] RBAC: Authorizing `identity:get_user(user_id=18f31a1c96ee4b1db0ad48ba98855581)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:22.971521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:22.973197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 102/200] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/users/18f31a1c96ee4b1db0ad48ba98855581 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:22.973989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:22.979594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:22.980219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:22.980501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:22.980775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.017295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:23.050529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:23.061815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:23.063470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:23.109098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcac1-4529-4994-91d2-502c6c896b92 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:23.156947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:23.157973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.158403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.158686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.160070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:23.162367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:23.164413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 103/201] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:23.165888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:23.184520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 99/202] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:23.185854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:23.300441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:23.305939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeb722-88e1-40b3-b61b-5cda87da7437 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:23.309147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a239-0f83-4f1f-be17-cd51f230b9a4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:23.319732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:23.348780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:23.350663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.350663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.350663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.350663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] RBAC: Adding query filter params (role.id=94d0c05b1d80413ea118bcce4ed86faf, scope.project.id=9eb915d3d58143368864175803663453, user.id=19e82661ec3143908b4a5bb6aa3bb18d) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:23.350992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:23.352404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:23.353572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:23.354420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.354801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.355269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.359779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 100/203] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:23 2022] GET /identity/v3/role_assignments?user.id=19e82661ec3143908b4a5bb6aa3bb18d&scope.project.id=9eb915d3d58143368864175803663453&role.id=94d0c05b1d80413ea118bcce4ed86faf => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:23.360773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:23.436999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:23.438555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:23.509732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbbb74-6270-4746-a00e-d241d29d4104 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:23.570532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 104/204] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:23.578294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:23.585717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:23.599943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:23.601490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.601490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.601490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.602431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:23.604359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:23.611917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 101/205] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:23 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:23.613878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:23.662911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:23.745293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9496-e9fb-4aa7-89b2-7a2dd97e4085 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:23.770528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73193267-441b-4c49-8017-92d82c84a0e5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:23.812621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:23.814253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.814813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.815807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.817176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:23.818939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:23.822129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 105/206] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:23 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:23.826767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2c650-d388-4df5-adb0-2280e096ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:23.827667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c650-d388-4df5-adb0-2280e096ede8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:23.828162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c650-d388-4df5-adb0-2280e096ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:23.828650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c650-d388-4df5-adb0-2280e096ede8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:23.829585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2c650-d388-4df5-adb0-2280e096ede8 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=18f31a1c96ee4b1db0ad48ba98855581) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:23.830088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2c650-d388-4df5-adb0-2280e096ede8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:23.831745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2c650-d388-4df5-adb0-2280e096ede8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:23.838543 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:23.841094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 102/207] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:23 2022] GET /identity/v3/role_assignments?user.id=18f31a1c96ee4b1db0ad48ba98855581&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:23.949540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:23.998486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff457f2-8eac-494c-92d1-e73b78c2d963 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:24.043853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc9f2-fc24-4ce4-b9e4-41b29eab8284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:24.045019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc9f2-fc24-4ce4-b9e4-41b29eab8284 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.045328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc9f2-fc24-4ce4-b9e4-41b29eab8284 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.049863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc9f2-fc24-4ce4-b9e4-41b29eab8284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.049863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc9f2-fc24-4ce4-b9e4-41b29eab8284 None admin] RBAC: Adding query filter params (role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=18f31a1c96ee4b1db0ad48ba98855581) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:24.049863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc9f2-fc24-4ce4-b9e4-41b29eab8284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:24.049863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc9f2-fc24-4ce4-b9e4-41b29eab8284 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:24.057836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 106/208] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:23 2022] GET /identity/v3/role_assignments?user.id=18f31a1c96ee4b1db0ad48ba98855581&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=f84356f9eb7648808591d233bb604d18 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:24.890984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f3a16-0612-41fc-b0af-fc9b86275f9a None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.891557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f3a16-0612-41fc-b0af-fc9b86275f9a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.891847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f3a16-0612-41fc-b0af-fc9b86275f9a None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.893505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 103/209] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:24.898803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbe6d-2460-4e73-a0c4-1aab1ed9c0ac None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:24.899201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbe6d-2460-4e73-a0c4-1aab1ed9c0ac None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:24.899616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbe6d-2460-4e73-a0c4-1aab1ed9c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:24.918654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2cfdbe6d-2460-4e73-a0c4-1aab1ed9c0ac None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:24.919922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2cfdbe6d-2460-4e73-a0c4-1aab1ed9c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:24.993400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 107/210] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:25.130537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0b01-d673-4114-8947-17beb617ccd8 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.130855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0b01-d673-4114-8947-17beb617ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.131091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0b01-d673-4114-8947-17beb617ccd8 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.132657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 104/211] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:25.137833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49539-0d27-4811-82a2-b129cfa07ff1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.138281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49539-0d27-4811-82a2-b129cfa07ff1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.138454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49539-0d27-4811-82a2-b129cfa07ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.157929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-36b49539-0d27-4811-82a2-b129cfa07ff1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:25.159075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-36b49539-0d27-4811-82a2-b129cfa07ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:25.223017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:25.230686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 108/212] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:25.281267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c0b01-d673-4114-8947-17beb617ccd8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:25.384313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:25.398157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c0b01-d673-4114-8947-17beb617ccd8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:25.435078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:25.435661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.435935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.436201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.446884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:25.452394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:25.453250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:25.454040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:25.458410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 105/213] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:25.460461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b49539-0d27-4811-82a2-b129cfa07ff1 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:25.538372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:25.571996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b49539-0d27-4811-82a2-b129cfa07ff1 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:25.615557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:25.616207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.616486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.616762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.617741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:25.618044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:25.620614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:25.635445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 109/214] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:25.637030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:25.665106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab62e88-db40-49d1-9fb7-67cfed42009d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:25.709669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:25.710229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.710509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.710779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.711946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:25.713993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:25.717039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 106/215] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:25.721992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:25.723838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:25.742732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:25.788839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754228a-04cc-4441-8c74-dacd289b912d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:25.830407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d4f50-b4c9-457d-bf84-54ed7ec490c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:25.831082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d4f50-b4c9-457d-bf84-54ed7ec490c3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.831456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d4f50-b4c9-457d-bf84-54ed7ec490c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.831904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d4f50-b4c9-457d-bf84-54ed7ec490c3 None admin] PATH_INFO: `/v3/users/ee55587b43d44315b022d5920f683726` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.847137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d4f50-b4c9-457d-bf84-54ed7ec490c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ee55587b43d44315b022d5920f683726)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:25.849295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d4f50-b4c9-457d-bf84-54ed7ec490c3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:25.853623 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b386b-30f7-4fa3-a8e8-765fbec3aa5f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:25.855131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 110/216] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:25 2022] GET /identity/v3/users/ee55587b43d44315b022d5920f683726 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:25.857501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f488be-2962-46ea-914e-68f04bb48098 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.857789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f488be-2962-46ea-914e-68f04bb48098 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.858066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f488be-2962-46ea-914e-68f04bb48098 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.859517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 111/217] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:25.860065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f488be-2962-46ea-914e-68f04bb48098 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:25.894397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140362a5-781b-424b-a7ee-f4d31941e9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:25.895083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140362a5-781b-424b-a7ee-f4d31941e9a5 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:25.895284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140362a5-781b-424b-a7ee-f4d31941e9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:25.895583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140362a5-781b-424b-a7ee-f4d31941e9a5 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:25.896278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140362a5-781b-424b-a7ee-f4d31941e9a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:25.897678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140362a5-781b-424b-a7ee-f4d31941e9a5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:25.968679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f488be-2962-46ea-914e-68f04bb48098 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:25.984991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:26.002559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:26.003161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.003480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.003754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.011073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 107/218] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:25 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:33:26.012602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52789-6c79-40d9-870a-0d6f4e0b532f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.013908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52789-6c79-40d9-870a-0d6f4e0b532f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.014211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52789-6c79-40d9-870a-0d6f4e0b532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.035900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a4b52789-6c79-40d9-870a-0d6f4e0b532f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:26.037536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a4b52789-6c79-40d9-870a-0d6f4e0b532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:26.083386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:26.084876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:26.123518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 108/219] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:26.125263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e8d1b-9d7e-4703-bc1e-d8d9c8817c7b None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.125785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e8d1b-9d7e-4703-bc1e-d8d9c8817c7b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.127031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e8d1b-9d7e-4703-bc1e-d8d9c8817c7b None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.129188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 109/220] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:26.135234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ee72-bc13-4a4a-89ae-8abe43dfc970 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.136057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ee72-bc13-4a4a-89ae-8abe43dfc970 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.136534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ee72-bc13-4a4a-89ae-8abe43dfc970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.147720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:26.161574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-51a5ee72-bc13-4a4a-89ae-8abe43dfc970 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:26.164190 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-51a5ee72-bc13-4a4a-89ae-8abe43dfc970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:26.204176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 112/221] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:26.209746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:26.228413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:26.249852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 110/222] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:26.317361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d21dd-2758-406b-9ad6-08163413043e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:26.359170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:26.360172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.360454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.360726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.361867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:26.363323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:26.365343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 113/223] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:26 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:26.371959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ee72-bc13-4a4a-89ae-8abe43dfc970 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:26.400866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:26.509438 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ee72-bc13-4a4a-89ae-8abe43dfc970 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:26.523534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:26.540444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142b769-56bc-4747-8ea6-fbfb7d3c5091 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:26.553204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:26.559505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:26.560876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.561249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.561619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.562460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=ee55587b43d44315b022d5920f683726) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:26.562869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:26.564703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:26.571064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 111/224] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:26 2022] GET /identity/v3/role_assignments?user.id=ee55587b43d44315b022d5920f683726&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=128a48837255468393c85bbc27310c38 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:26.573370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:26.587217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:26.588489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.594923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.594923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.605353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:26.613140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:26.614284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:26.615298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:26.617470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 114/225] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:26.624527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:26.702947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763801d6-b257-4108-9eb1-45d4048cc68f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:26.744759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:26.745410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.745684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.749095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.758511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:26.764853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:26.765914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:26.766717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:26.770670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 112/226] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:26.772057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:26.879790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f042d-92cb-4d40-8090-a9548e50f249 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:26.887747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:26.901342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e7659-f51c-48a3-b3ff-115e0e232b71 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:26.917276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:26.917895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:26.918234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:26.918506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:26.919757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:26.920057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:26.921619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:26.934826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 113/227] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:26.936313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.008328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.009306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.009789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.010261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.016941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:27.019870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.021335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.047033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab558096-8369-4ad8-a9f3-b2d486f0a19b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:27.049251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 115/228] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:27.056308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.080715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:27.083882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:27.087477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.088129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.088412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.095939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] PATH_INFO: `/v3/users/18f31a1c96ee4b1db0ad48ba98855581` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.095939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] RBAC: Authorizing `identity:get_user(user_id=18f31a1c96ee4b1db0ad48ba98855581)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.095939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.096826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 114/229] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:26 2022] GET /identity/v3/users/18f31a1c96ee4b1db0ad48ba98855581 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:27.100424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.232076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40c85e-e77f-46ed-881b-ecdc937a50de None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:27.269701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.270752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.271107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.271498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.272705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.274754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.276836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 115/230] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:27 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:27.282857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.312444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8e505-3416-477e-9871-02e0714dbc6c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:27.347762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:27.403609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.404438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.404808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.405188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] PATH_INFO: `/v3/users/18f31a1c96ee4b1db0ad48ba98855581` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.406488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] RBAC: Authorizing `identity:get_user(user_id=18f31a1c96ee4b1db0ad48ba98855581)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.408186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.410326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 116/231] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:27 2022] GET /identity/v3/users/18f31a1c96ee4b1db0ad48ba98855581 => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:27.413482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7101ef-d2f4-485b-a708-97cabcaa3fc6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:27.416162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.482844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.484028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.484509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.485129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/18f31a1c96ee4b1db0ad48ba98855581/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.489159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] RBAC: Authorizing `identity:create_grant(project_id=3609b26ed3b7446caca874a5e0c4d89f, user_id=18f31a1c96ee4b1db0ad48ba98855581, role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.492065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.544411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:27.572218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a24e55-68b4-4c24-99a1-be74a4c64e57 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:27.583794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 116/232] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:27 2022] PUT /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/18f31a1c96ee4b1db0ad48ba98855581/roles/f84356f9eb7648808591d233bb604d18 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:27.625391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e016da-ddcb-4b83-8669-34b34d497571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.626054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e016da-ddcb-4b83-8669-34b34d497571 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.626345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e016da-ddcb-4b83-8669-34b34d497571 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.626621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e016da-ddcb-4b83-8669-34b34d497571 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.627861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e016da-ddcb-4b83-8669-34b34d497571 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.629387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e016da-ddcb-4b83-8669-34b34d497571 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.631500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 117/233] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:27 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:27.637164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:27.787697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dfab1-b208-4fa9-bca3-442244a13e1f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:27.818535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:27.833651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356562-c854-4f01-bb64-9e62917dea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:27.834878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356562-c854-4f01-bb64-9e62917dea2f None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:27.835386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356562-c854-4f01-bb64-9e62917dea2f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:27.835859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356562-c854-4f01-bb64-9e62917dea2f None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/18f31a1c96ee4b1db0ad48ba98855581/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:27.838087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356562-c854-4f01-bb64-9e62917dea2f None admin] RBAC: Authorizing `identity:create_grant(project_id=3609b26ed3b7446caca874a5e0c4d89f, user_id=18f31a1c96ee4b1db0ad48ba98855581, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:27.839908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356562-c854-4f01-bb64-9e62917dea2f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:27.940052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 117/234] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:27 2022] PUT /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/18f31a1c96ee4b1db0ad48ba98855581/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:28.527064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babf24-1c54-4314-acbb-f6ca64981d83 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.528102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babf24-1c54-4314-acbb-f6ca64981d83 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.529178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babf24-1c54-4314-acbb-f6ca64981d83 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.530783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 118/235] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:28.536475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db33868-535d-4fae-924c-674946aa33bb None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.537055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db33868-535d-4fae-924c-674946aa33bb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.537534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db33868-535d-4fae-924c-674946aa33bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.557057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7db33868-535d-4fae-924c-674946aa33bb None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:28.558671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7db33868-535d-4fae-924c-674946aa33bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:28.629893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 118/236] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:28.734972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f5d72-5ead-490c-9160-81fd70d0b6a9 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.735290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f5d72-5ead-490c-9160-81fd70d0b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.735557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f5d72-5ead-490c-9160-81fd70d0b6a9 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.736906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 119/237] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:28.742400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df156d9b-aded-4961-bd79-d09b72c087a7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:28.742689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df156d9b-aded-4961-bd79-d09b72c087a7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:28.743003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df156d9b-aded-4961-bd79-d09b72c087a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:28.761396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-df156d9b-aded-4961-bd79-d09b72c087a7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:28.763230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-df156d9b-aded-4961-bd79-d09b72c087a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:28.861795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 119/238] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:28.922889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f5d72-5ead-490c-9160-81fd70d0b6a9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.035651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f5d72-5ead-490c-9160-81fd70d0b6a9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.070337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.071388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.071911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.072381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.078680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bff83-0e3b-466a-8395-1eeba3d5442f None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.079142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bff83-0e3b-466a-8395-1eeba3d5442f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.079251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bff83-0e3b-466a-8395-1eeba3d5442f None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.081870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 120/239] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:29.084740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:29.085866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc730-3b82-4e67-a82a-fe119e6861e7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.086196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc730-3b82-4e67-a82a-fe119e6861e7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.086481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc730-3b82-4e67-a82a-fe119e6861e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:29.090697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:29.091586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:29.092417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:29.093017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 120/240] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:29.099224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.102993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.110181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-cd2fc730-3b82-4e67-a82a-fe119e6861e7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:29.111685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cd2fc730-3b82-4e67-a82a-fe119e6861e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:29.142672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.182527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 121/241] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:29.187931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fc730-3b82-4e67-a82a-fe119e6861e7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.290744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fc730-3b82-4e67-a82a-fe119e6861e7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.331351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.332308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.332766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.333213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.334676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.336325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.338493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 122/242] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:29.344361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.345892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b0b8d-a49a-4f1f-8450-5a7082a3b3a4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.407746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.408066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.408704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.408992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.409273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.409963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:29.410272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.411703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.435777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 121/243] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:29.436631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.466042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a85a9c-2df8-4d65-94ab-d106243b5fe5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.516992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.518456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.519220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.519858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.521429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.523627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.527509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.567160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bac0a-5904-409a-a769-0fd28395a7cb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.602595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.603246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.603547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.603826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] PATH_INFO: `/v3/users/b6e6251a06ad4266a9c1da0a96a6fbbe` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.618407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e6251a06ad4266a9c1da0a96a6fbbe)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.619908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:29.626112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 122/244] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/users/b6e6251a06ad4266a9c1da0a96a6fbbe => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:29.626112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.632147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 123/245] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:29 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:29.632987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.738384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.753599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c521a-6725-498d-bca1-5dc62ede7b64 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.765980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c50f1-c1e5-4751-98f1-f8f360903203 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:29.792440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f9268-6b05-4290-ac1b-00d06d57f35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.793335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9268-6b05-4290-ac1b-00d06d57f35b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.793622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9268-6b05-4290-ac1b-00d06d57f35b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.794462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9268-6b05-4290-ac1b-00d06d57f35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.800885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:29.828022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:29.828732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:29.829013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:29.829281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:29.865253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:29.876926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:29.877860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:29.878639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:29.886212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 123/246] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:29.887907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:29.922528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f9268-6b05-4290-ac1b-00d06d57f35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:29.924191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f9268-6b05-4290-ac1b-00d06d57f35b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:30.029051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a75ea-34ae-41af-b42a-f7996401a626 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:30.035774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:30.054126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 124/247] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:30.054126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131477-833b-4cb4-9ba6-2c14893c5a02 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.054126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131477-833b-4cb4-9ba6-2c14893c5a02 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.054452 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131477-833b-4cb4-9ba6-2c14893c5a02 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.055800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 125/248] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:30.063193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2131477-833b-4cb4-9ba6-2c14893c5a02 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:30.089762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af1d9-402b-44b0-a432-4ae4adb5f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:30.090377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af1d9-402b-44b0-a432-4ae4adb5f904 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.091210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af1d9-402b-44b0-a432-4ae4adb5f904 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.091603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af1d9-402b-44b0-a432-4ae4adb5f904 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.092253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af1d9-402b-44b0-a432-4ae4adb5f904 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:30.092558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af1d9-402b-44b0-a432-4ae4adb5f904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:30.094205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af1d9-402b-44b0-a432-4ae4adb5f904 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:30.107382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 124/249] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:30.107382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036e4e-20f0-4a8c-a699-3a93ba896926 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.107382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036e4e-20f0-4a8c-a699-3a93ba896926 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.107382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036e4e-20f0-4a8c-a699-3a93ba896926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.126519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-be036e4e-20f0-4a8c-a699-3a93ba896926 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:30.127749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-be036e4e-20f0-4a8c-a699-3a93ba896926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:30.183273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:30.206069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2131477-833b-4cb4-9ba6-2c14893c5a02 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:30.217414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 125/250] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:30.218790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036e4e-20f0-4a8c-a699-3a93ba896926 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:30.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:30.253864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.254144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.254415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.255728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:30.257259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:30.263649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 126/251] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:30 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:30.266001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:30.362148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036e4e-20f0-4a8c-a699-3a93ba896926 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:30.369958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:30.419385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:30.419385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.423385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.423385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] PATH_INFO: `/v3/users/ee55587b43d44315b022d5920f683726` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.423385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=ee55587b43d44315b022d5920f683726)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:30.423385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:30.427659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 126/252] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:30 2022] GET /identity/v3/users/ee55587b43d44315b022d5920f683726 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:30.433318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:30.472435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53638e35-a7f6-4c46-ab9b-1fb83fe1c940 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:30.512358 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:30.534830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:30.535476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.535756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.536026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.536772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] RBAC: Adding query filter params (role.id=94d0c05b1d80413ea118bcce4ed86faf, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=b6e6251a06ad4266a9c1da0a96a6fbbe) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:30.537085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:30.538540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:30.544886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 127/253] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:30 2022] GET /identity/v3/role_assignments?user.id=b6e6251a06ad4266a9c1da0a96a6fbbe&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=94d0c05b1d80413ea118bcce4ed86faf => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:30.545738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:30.580330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72e35-9949-4a96-b66d-a1d6b6a82ae7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:30.620643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:30.621261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.621546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.622407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.623673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:30.625181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:30.627275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 127/254] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:30 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:30.633047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:30.653831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841145f-7311-42ef-b5f3-b94f914c6919 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:30.675920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:30.691177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79f20f-81a1-424a-a3d0-11803555e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:30.691970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f20f-81a1-424a-a3d0-11803555e1bc None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.692321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f20f-81a1-424a-a3d0-11803555e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.692664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f20f-81a1-424a-a3d0-11803555e1bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.705794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79f20f-81a1-424a-a3d0-11803555e1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-7d79f20f-81a1-424a-a3d0-11803555e1bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:30.710775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:30.712630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:30.714530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 128/255] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:30.716044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709277d-b9dd-4420-b819-a05b6e3e172e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.716044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709277d-b9dd-4420-b819-a05b6e3e172e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.716308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709277d-b9dd-4420-b819-a05b6e3e172e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.718649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 129/256] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:30.725539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c6f3c-dbce-443e-8dc0-b4e696eb8fc5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.725539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c6f3c-dbce-443e-8dc0-b4e696eb8fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.725539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c6f3c-dbce-443e-8dc0-b4e696eb8fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.756610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-665c6f3c-dbce-443e-8dc0-b4e696eb8fc5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:30.758102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-665c6f3c-dbce-443e-8dc0-b4e696eb8fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:30.761004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0fbe-a2b0-48da-8733-1ff6e74b55dc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:30.773201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:30.822122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:30.823124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:30.823704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:30.824166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/ee55587b43d44315b022d5920f683726/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:30.827829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] RBAC: Authorizing `identity:create_grant(project_id=3609b26ed3b7446caca874a5e0c4d89f, user_id=ee55587b43d44315b022d5920f683726, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:30.830261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:30.857471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 130/257] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:30.858755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c6f3c-dbce-443e-8dc0-b4e696eb8fc5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:30.915820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 128/258] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:30 2022] PUT /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/ee55587b43d44315b022d5920f683726/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:31.007696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c6f3c-dbce-443e-8dc0-b4e696eb8fc5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:31.024443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:31.053447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:31.054076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.054355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.054626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.055436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:31.055751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:31.057182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:31.071170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 131/259] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:31.077759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.199554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355adc7-cf82-434a-9733-1e7b810dbf41 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:31.238403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:31.239347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.239837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.240293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] PATH_INFO: `/v3/users/18f31a1c96ee4b1db0ad48ba98855581` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.243048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] RBAC: Authorizing `identity:get_user(user_id=18f31a1c96ee4b1db0ad48ba98855581)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:31.244899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:31.247157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 129/260] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/users/18f31a1c96ee4b1db0ad48ba98855581 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:31.252692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.296603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.346748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:31.430151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027b7f-81a1-4d0f-809c-9fb01e089286 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:31.472351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019712d4-007f-45f5-b861-a53c3ebad698 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:31.472611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:31.473450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.473996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.474451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.488098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:31.494594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:31.495519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:31.496313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:31.503417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 130/261] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:31.504844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.576780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:31.577405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.577688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.577962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.625734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:31.631444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b3577-f7b0-45a5-9e77-095fd773a0d0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:31.697806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:31.698729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.699176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.699636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.701167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:31.701586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:31.703694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:31.706518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:31.733784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 131/262] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:31.744975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.750680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:31.752269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:31.861668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97ea0-5b9a-4569-b6b1-9599cd27e284 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:31.902901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:31.903963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:31.904441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:31.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] PATH_INFO: `/v3/users/18f31a1c96ee4b1db0ad48ba98855581` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:31.906368 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] RBAC: Authorizing `identity:get_user(user_id=18f31a1c96ee4b1db0ad48ba98855581)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:31.908077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:31.914561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 132/264] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:31.915129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 132/264] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/users/18f31a1c96ee4b1db0ad48ba98855581 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:31.916079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.916736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:31.948447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.032937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec99a-67e2-4e5b-b0bd-ff094eaaeafa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.068682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.071282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.072177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.072684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.073172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.154044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023d14-582b-46b6-a57e-28f2c2a53020 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.183392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.186108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.224774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.271189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.271884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.272133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.272405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.276061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.277533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.279791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 133/265] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:32.285406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.320338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 133/266] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:32.323415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.481608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde9f1f-23f5-4d52-82c8-a542e7248e05 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.498397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2c138-d748-4462-bc3a-3e70e3d5a767 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.545456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.558947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.576948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.576948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.576948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.576948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.576948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.576948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 134/267] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:32.577362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:32.577429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332e959-a3c6-4f95-beb4-1ed5cc19b414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.577901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332e959-a3c6-4f95-beb4-1ed5cc19b414 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.578370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332e959-a3c6-4f95-beb4-1ed5cc19b414 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.578839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332e959-a3c6-4f95-beb4-1ed5cc19b414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.579811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332e959-a3c6-4f95-beb4-1ed5cc19b414 None admin] RBAC: Adding query filter params (role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=18f31a1c96ee4b1db0ad48ba98855581) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:32.580360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332e959-a3c6-4f95-beb4-1ed5cc19b414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.582110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332e959-a3c6-4f95-beb4-1ed5cc19b414 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.601819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 134/268] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/role_assignments?user.id=18f31a1c96ee4b1db0ad48ba98855581&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=f84356f9eb7648808591d233bb604d18 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:32.738467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747d6f-8ac8-42b5-a2d8-abdc1cf752e0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:32.770620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fc68-51d3-4dfe-87cf-669a3de072c9 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.770954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fc68-51d3-4dfe-87cf-669a3de072c9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.771238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44fc68-51d3-4dfe-87cf-669a3de072c9 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.772990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 135/269] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:32.779290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320071a8-c121-4fdd-b812-91cb01cbd586 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.779621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320071a8-c121-4fdd-b812-91cb01cbd586 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.779872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320071a8-c121-4fdd-b812-91cb01cbd586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.786019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:32.786640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:32.786922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:32.787198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:32.787971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=18f31a1c96ee4b1db0ad48ba98855581) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:32.788286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:32.789722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:32.795799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:32.802986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 135/270] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:32 2022] GET /identity/v3/role_assignments?user.id=18f31a1c96ee4b1db0ad48ba98855581&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:32.810749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-320071a8-c121-4fdd-b812-91cb01cbd586 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:32.812049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-320071a8-c121-4fdd-b812-91cb01cbd586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:32.896789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 136/271] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:33.196101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:33.217251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6f616-c487-4b4b-b013-c3c4d50cc234 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.217560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6f616-c487-4b4b-b013-c3c4d50cc234 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.217806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6f616-c487-4b4b-b013-c3c4d50cc234 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.219434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 137/272] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:33.224961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354a95-47f6-4644-a2fc-4c16a1f7194a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.225235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354a95-47f6-4644-a2fc-4c16a1f7194a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.225550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354a95-47f6-4644-a2fc-4c16a1f7194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.256400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-04354a95-47f6-4644-a2fc-4c16a1f7194a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:33.257779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-04354a95-47f6-4644-a2fc-4c16a1f7194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:33.264906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:33.315026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030e3d-ef9c-47e8-bf1f-37cb1357ea05 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:33.360266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:33.361248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.361532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.361803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.380124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 138/273] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:33.388638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:33.394454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:33.395316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:33.396153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:33.398758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 136/274] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:33.405705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:33.405851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef644-5848-4830-bff8-d5224b8ee55e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.405851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef644-5848-4830-bff8-d5224b8ee55e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.405851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef644-5848-4830-bff8-d5224b8ee55e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.407091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 139/275] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:33.412016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa496a-88fb-4dd3-88aa-7a385def7855 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.412301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa496a-88fb-4dd3-88aa-7a385def7855 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.412576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa496a-88fb-4dd3-88aa-7a385def7855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.432678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-b7aa496a-88fb-4dd3-88aa-7a385def7855 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:33.434189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b7aa496a-88fb-4dd3-88aa-7a385def7855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:33.504771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:33.513882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 140/276] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:33.534207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7c80c-ca71-4f96-a4aa-30366c965e98 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:33.555091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:33.569224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:33.569837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.570120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.570398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.571074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:33.571399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:33.572793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:33.581964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 137/277] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:33.587545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa496a-88fb-4dd3-88aa-7a385def7855 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:33.656167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:33.705063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa496a-88fb-4dd3-88aa-7a385def7855 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:33.742876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:33.743645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.743929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.744199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] PATH_INFO: `/v3/users/3505f95da37545d1affd8928a598cd46` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.761082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=3505f95da37545d1affd8928a598cd46)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:33.764197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:33.767044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 141/278] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:33 2022] GET /identity/v3/users/3505f95da37545d1affd8928a598cd46 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:33.773910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:33.795240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0ab78-1045-4dac-b8ac-20f01f67c1a9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:33.830856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:33.834407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a455b-c030-4844-8e3e-974738006acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:33.835032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a455b-c030-4844-8e3e-974738006acd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.835387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a455b-c030-4844-8e3e-974738006acd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.835723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a455b-c030-4844-8e3e-974738006acd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.836827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a455b-c030-4844-8e3e-974738006acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:33.838257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a455b-c030-4844-8e3e-974738006acd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:33.841533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 138/279] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:33.841533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a455b-c030-4844-8e3e-974738006acd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:33.878874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31399-7beb-4c60-b05c-68bfeeb00ff2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:33.902749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:33.915065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56a14a-dac2-4165-bba3-235deba0b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:33.923096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56a14a-dac2-4165-bba3-235deba0b001 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.923096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56a14a-dac2-4165-bba3-235deba0b001 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.923096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56a14a-dac2-4165-bba3-235deba0b001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.923096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56a14a-dac2-4165-bba3-235deba0b001 None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, user.id=3505f95da37545d1affd8928a598cd46, scope.system=all) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:33.923096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56a14a-dac2-4165-bba3-235deba0b001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:33.923096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56a14a-dac2-4165-bba3-235deba0b001 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:33.927560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 142/280] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Aug 18 20:33:33 2022] GET /identity/v3/role_assignments?user.id=3505f95da37545d1affd8928a598cd46&scope.system=all&role.id=128a48837255468393c85bbc27310c38 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:33.929193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07852-ee78-4ef1-ab27-ecd6384a5ed8 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:33.929477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07852-ee78-4ef1-ab27-ecd6384a5ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:33.929751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07852-ee78-4ef1-ab27-ecd6384a5ed8 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:33.933188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 143/281] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:33.933188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff07852-ee78-4ef1-ab27-ecd6384a5ed8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:33.961466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a455b-c030-4844-8e3e-974738006acd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.000671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99298a2b-e7fb-4a96-b462-fc28b28d5faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.001404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99298a2b-e7fb-4a96-b462-fc28b28d5faa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.001806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99298a2b-e7fb-4a96-b462-fc28b28d5faa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.002075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99298a2b-e7fb-4a96-b462-fc28b28d5faa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.014921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99298a2b-e7fb-4a96-b462-fc28b28d5faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-99298a2b-e7fb-4a96-b462-fc28b28d5faa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:34.020378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:34.021508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:34.022285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 139/282] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:34.023770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243a865-a703-4a83-9153-0d1c2b2c3461 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.023770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243a865-a703-4a83-9153-0d1c2b2c3461 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.023770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243a865-a703-4a83-9153-0d1c2b2c3461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.043659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d243a865-a703-4a83-9153-0d1c2b2c3461 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:34.044971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d243a865-a703-4a83-9153-0d1c2b2c3461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:34.056746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff07852-ee78-4ef1-ab27-ecd6384a5ed8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.076448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:34.095484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.097462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.097462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.097462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.097882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:34.099523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:34.118849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 140/283] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:34.120080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243a865-a703-4a83-9153-0d1c2b2c3461 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.179126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:34.222392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 144/284] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:33:33 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:34.249673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243a865-a703-4a83-9153-0d1c2b2c3461 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.291347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.292305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.292806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.293223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.294785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:34.295324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:34.296913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:34.307913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 141/285] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:34.316271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.412920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.435757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8df71-d9fd-4392-89f2-53241fb7d3d4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.475008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.475680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.475958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.476231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] PATH_INFO: `/v3/users/b6e6251a06ad4266a9c1da0a96a6fbbe` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.478368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e6251a06ad4266a9c1da0a96a6fbbe)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:34.479857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:34.482155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 145/286] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:34 2022] GET /identity/v3/users/b6e6251a06ad4266a9c1da0a96a6fbbe => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:34.487611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.544146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:34.548031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714bae-f636-480b-ba31-a94c622d0d60 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.550036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:34.593597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.594575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.595052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.595432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.608821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:34.614025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:34.618513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:34.619309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 142/287] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:34.620006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6525f5-bd18-4f6e-965e-97a11acd4a56 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.622531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.662802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.663574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.663926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.664271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.665517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:34.667044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:34.670124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 146/288] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:34 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:34.676785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.769295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b4ebb-3a89-4711-8b6c-8ba651ec8d15 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.810374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.811119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.811425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.811705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.812375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:34.812679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:34.814254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:34.817267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d203-a49e-4337-961d-9ade0127d5ec None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:34.824142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 143/289] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:34.828274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:34.831622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:34.872670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:34.873721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:34.874193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:34.874716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/b6e6251a06ad4266a9c1da0a96a6fbbe/roles/94d0c05b1d80413ea118bcce4ed86faf` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:34.878018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3609b26ed3b7446caca874a5e0c4d89f, user_id=b6e6251a06ad4266a9c1da0a96a6fbbe, role_id=94d0c05b1d80413ea118bcce4ed86faf)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:34.880289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:34.887841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:34.956264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 147/290] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:33:34 2022] PUT /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/users/b6e6251a06ad4266a9c1da0a96a6fbbe/roles/94d0c05b1d80413ea118bcce4ed86faf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:33:34.977700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9f036-0785-4b10-a51a-db42957714e5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:35.033208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:35.034409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:35.034889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:35.035377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] PATH_INFO: `/v3/users/ee55587b43d44315b022d5920f683726` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:35.037068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] RBAC: Authorizing `identity:get_user(user_id=ee55587b43d44315b022d5920f683726)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:35.038907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:35.041170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 144/291] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:34 2022] GET /identity/v3/users/ee55587b43d44315b022d5920f683726 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:35.047303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:35.188792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec47a55-2f11-4b23-8458-ded9d6a24cc8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:35.226024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:35.227027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:35.227559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:35.228053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:35.266643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:35.306195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:35.308077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:35.450793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 148/292] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:35.456505 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:35.585939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:35.595046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc2a8f-7a2e-447e-9284-d2caf58ce39b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:35.629929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ef00-d73b-4f0a-bfc7-b82683a10cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:35.630574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ef00-d73b-4f0a-bfc7-b82683a10cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:35.630857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ef00-d73b-4f0a-bfc7-b82683a10cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:35.631133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ef00-d73b-4f0a-bfc7-b82683a10cf3 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:35.632362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2ef00-d73b-4f0a-bfc7-b82683a10cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:35.633814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2ef00-d73b-4f0a-bfc7-b82683a10cf3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:35.635822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 145/293] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:35 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:35.644721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:35.753617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:35.790941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afdf1c-d1c4-404f-a177-9b0f87a21aba None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:35.826943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0661-01fc-4e19-91c6-0d2c722dcf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:35.827598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0661-01fc-4e19-91c6-0d2c722dcf14 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:35.827876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0661-01fc-4e19-91c6-0d2c722dcf14 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:35.828144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0661-01fc-4e19-91c6-0d2c722dcf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:35.829020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0661-01fc-4e19-91c6-0d2c722dcf14 None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=ee55587b43d44315b022d5920f683726) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:35.829331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0661-01fc-4e19-91c6-0d2c722dcf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:35.830808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0661-01fc-4e19-91c6-0d2c722dcf14 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:35.838064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 149/294] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:35 2022] GET /identity/v3/role_assignments?user.id=ee55587b43d44315b022d5920f683726&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=128a48837255468393c85bbc27310c38 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:36.087114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0b5aa-5fec-42ac-9f63-094e2ed84965 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.087629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0b5aa-5fec-42ac-9f63-094e2ed84965 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.087629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0b5aa-5fec-42ac-9f63-094e2ed84965 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.088981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 146/295] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:36.095048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f112b9-d0a5-4e7e-bf34-b4be2cada6c7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.095589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f112b9-d0a5-4e7e-bf34-b4be2cada6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.096060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f112b9-d0a5-4e7e-bf34-b4be2cada6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.115301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-84f112b9-d0a5-4e7e-bf34-b4be2cada6c7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:36.116779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-84f112b9-d0a5-4e7e-bf34-b4be2cada6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:36.187868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 150/296] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:36.477717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0b5aa-5fec-42ac-9f63-094e2ed84965 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:36.592475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0b5aa-5fec-42ac-9f63-094e2ed84965 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:36.628284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88a781-a39d-4387-8964-27671e681a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:36.628846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88a781-a39d-4387-8964-27671e681a95 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.629129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88a781-a39d-4387-8964-27671e681a95 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.629406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88a781-a39d-4387-8964-27671e681a95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.640349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88a781-a39d-4387-8964-27671e681a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-0b88a781-a39d-4387-8964-27671e681a95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:36.645467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:36.646584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:36.647401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 147/297] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:36.654989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f112b9-d0a5-4e7e-bf34-b4be2cada6c7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:36.720527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:36.763074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f112b9-d0a5-4e7e-bf34-b4be2cada6c7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:36.789750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f73e-7788-4c6f-a077-44cc21a545b1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.790085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f73e-7788-4c6f-a077-44cc21a545b1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.790306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f73e-7788-4c6f-a077-44cc21a545b1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.792960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 148/298] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:36.797263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06934-0b15-43ab-8307-2d4ee6dd0e01 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.797565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06934-0b15-43ab-8307-2d4ee6dd0e01 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.797827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06934-0b15-43ab-8307-2d4ee6dd0e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.805712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:36.807004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.807721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.808392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.809749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:36.810510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:36.813322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:36.817518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5fa06934-0b15-43ab-8307-2d4ee6dd0e01 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:36.818768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5fa06934-0b15-43ab-8307-2d4ee6dd0e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:36.826124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 151/299] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:36.834572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:36.841399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:36.924956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 149/300] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:36.926189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb631-15ac-41e5-a52e-4be3b7af05fe None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.926473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb631-15ac-41e5-a52e-4be3b7af05fe None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.926742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cb631-15ac-41e5-a52e-4be3b7af05fe None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.928163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 150/301] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:36.935442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18020d6-3ed6-483e-9e71-9ce22f58ca9f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:36.935442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18020d6-3ed6-483e-9e71-9ce22f58ca9f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:36.935442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18020d6-3ed6-483e-9e71-9ce22f58ca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:36.953289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e18020d6-3ed6-483e-9e71-9ce22f58ca9f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:36.954644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e18020d6-3ed6-483e-9e71-9ce22f58ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:36.972556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4055e7-2030-4891-a902-4286b4649045 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.004530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:37.016245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:37.020242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.020242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.020242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] PATH_INFO: `/v3/users/3505f95da37545d1affd8928a598cd46` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.020242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] RBAC: Authorizing `identity:get_user(user_id=3505f95da37545d1affd8928a598cd46)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:37.020242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:37.022133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 152/302] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:36 2022] GET /identity/v3/users/3505f95da37545d1affd8928a598cd46 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:37.029065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:37.042760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 151/303] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:37.142173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada985d-02b6-4e08-bf4f-dc6e807d3426 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.177192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:37.177772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.178050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.178324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] PATH_INFO: `/v3/system/users/3505f95da37545d1affd8928a598cd46/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.180015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3505f95da37545d1affd8928a598cd46, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:37.181468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:37.221422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18020d6-3ed6-483e-9e71-9ce22f58ca9f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:37.282833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 153/304] 10.222.0.62 () {58 vars in 1334 bytes} [Thu Aug 18 20:33:37 2022] PUT /identity/v3/system/users/3505f95da37545d1affd8928a598cd46/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:37.309685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:37.328608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:37.358278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18020d6-3ed6-483e-9e71-9ce22f58ca9f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.391815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:37.407217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264fd12-fc89-4507-ba25-96bd4cbb08aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:37.408342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264fd12-fc89-4507-ba25-96bd4cbb08aa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.409879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264fd12-fc89-4507-ba25-96bd4cbb08aa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.409879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264fd12-fc89-4507-ba25-96bd4cbb08aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.411212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264fd12-fc89-4507-ba25-96bd4cbb08aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:37.413886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264fd12-fc89-4507-ba25-96bd4cbb08aa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:37.417785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 152/305] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:37.417785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc07a5-ad2e-48c9-b5d9-eab35f0e2114 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.418164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc07a5-ad2e-48c9-b5d9-eab35f0e2114 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.418525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc07a5-ad2e-48c9-b5d9-eab35f0e2114 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.420152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 153/306] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:37.426044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f37a7-f9f7-4f09-916f-5d4e0a7df040 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.426334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f37a7-f9f7-4f09-916f-5d4e0a7df040 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.426701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f37a7-f9f7-4f09-916f-5d4e0a7df040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.446255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f879-945d-4041-8b80-18600c7b5ac4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.448877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-101f37a7-f9f7-4f09-916f-5d4e0a7df040 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:37.450731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-101f37a7-f9f7-4f09-916f-5d4e0a7df040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:37.495901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:37.497165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.497473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.497724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.512957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:37.522371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:37.523340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:37.524330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 154/307] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:37.524994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:37.548734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 154/308] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:37.555586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f37a7-f9f7-4f09-916f-5d4e0a7df040 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:37.646796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d269d-099c-45f0-abe9-f638da8bf8b1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.655895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:37.664228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:37.684879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:37.685514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.685811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.686086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] PATH_INFO: `/v3/groups` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.686720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:37.687649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f37a7-f9f7-4f09-916f-5d4e0a7df040 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.688222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:37.722683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:37.723212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.723525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.723795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.724526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:37.724828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:37.726242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:37.736713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 155/309] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:37.741983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:37.804067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 155/310] 10.222.0.62 () {60 vars in 1134 bytes} [Thu Aug 18 20:33:37 2022] POST /identity/v3/groups => generated 229 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:37.826043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:37.889951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5d01-56ef-41fd-995f-4be08bc6544f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.941415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:37.942066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:37.942351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:37.942629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] PATH_INFO: `/v3/users/26b81b78f2e84bee904f0da98a0457cf` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:37.955747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:37.960491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] RBAC: Authorizing `identity:get_user(user_id=26b81b78f2e84bee904f0da98a0457cf)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:37.962273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:37.963125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7f63f-c901-4c33-9f78-e1df86dc619c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:37.964743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 156/311] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:37 2022] GET /identity/v3/users/26b81b78f2e84bee904f0da98a0457cf => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:37.972444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:38.012950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:38.013852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.014136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.014405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.026590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:38.032479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:38.033407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:38.038981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 156/312] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:38.041244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:38.091053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.102231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d0e3-a308-4526-8b4b-7e6cf8672573 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:38.150049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:38.150745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.151037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.151336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.152165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] RBAC: Adding query filter params (role.id=94d0c05b1d80413ea118bcce4ed86faf, user.id=26b81b78f2e84bee904f0da98a0457cf, scope.system=all) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:38.152479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:38.154539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:38.160318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 157/313] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Aug 18 20:33:37 2022] GET /identity/v3/role_assignments?user.id=26b81b78f2e84bee904f0da98a0457cf&scope.system=all&role.id=94d0c05b1d80413ea118bcce4ed86faf => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:38.175280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb8ff-54ef-44e7-98fe-fbca14facee9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:38.216099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:38.216733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.217069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.217351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.218042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:38.218353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:38.219825 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:38.234033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 157/314] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:38.236168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:38.309809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.366054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2f18-771d-4dba-9d4a-59d34c95b942 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:38.406038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:38.407069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.407612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.408120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] PATH_INFO: `/v3/users/b6e6251a06ad4266a9c1da0a96a6fbbe` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.409667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e6251a06ad4266a9c1da0a96a6fbbe)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:38.411706 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:38.414071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 158/315] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:38 2022] GET /identity/v3/users/b6e6251a06ad4266a9c1da0a96a6fbbe => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:38.419963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:38.525786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.530555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2969-6c23-46f7-8e7d-2572dd895b1f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:38.564903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:38.565885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.566368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.566857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.636632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:38.639388 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:38.741497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.747207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 158/316] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:38.756471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:38.866668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c656efb-aa97-41ee-bd32-76c5f5fe9c36 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:38.897340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:38.904822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04fd98-94f1-4d2b-8454-95ed7e54bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:38.905452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04fd98-94f1-4d2b-8454-95ed7e54bc63 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:38.905731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04fd98-94f1-4d2b-8454-95ed7e54bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:38.911446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04fd98-94f1-4d2b-8454-95ed7e54bc63 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:38.911446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04fd98-94f1-4d2b-8454-95ed7e54bc63 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:38.911446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04fd98-94f1-4d2b-8454-95ed7e54bc63 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:38.911797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 159/317] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:38 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:38.917698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.021772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b697-cabf-4e01-bbf2-57397b7383eb None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.059256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b63e-c4fa-4aae-8676-b9a4f0c814df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.059894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b63e-c4fa-4aae-8676-b9a4f0c814df None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.060231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b63e-c4fa-4aae-8676-b9a4f0c814df None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.060503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b63e-c4fa-4aae-8676-b9a4f0c814df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.061288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5b63e-c4fa-4aae-8676-b9a4f0c814df None admin] RBAC: Adding query filter params (role.id=94d0c05b1d80413ea118bcce4ed86faf, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f, user.id=b6e6251a06ad4266a9c1da0a96a6fbbe) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:39.061598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5b63e-c4fa-4aae-8676-b9a4f0c814df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.063034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5b63e-c4fa-4aae-8676-b9a4f0c814df None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.069221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 159/318] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:33:38 2022] GET /identity/v3/role_assignments?user.id=b6e6251a06ad4266a9c1da0a96a6fbbe&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=94d0c05b1d80413ea118bcce4ed86faf => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:39.247759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6083a9-9173-48d5-a8a8-4dba2eba64a2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.248248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6083a9-9173-48d5-a8a8-4dba2eba64a2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.248323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6083a9-9173-48d5-a8a8-4dba2eba64a2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.249842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 160/319] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:39.255195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c18b9-a308-4515-8208-d6aab433f2a5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.255739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c18b9-a308-4515-8208-d6aab433f2a5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.256288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c18b9-a308-4515-8208-d6aab433f2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.276361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a71c18b9-a308-4515-8208-d6aab433f2a5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:39.278527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a71c18b9-a308-4515-8208-d6aab433f2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:39.336758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:39.348222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 160/320] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:39.617189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6083a9-9173-48d5-a8a8-4dba2eba64a2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.720013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6083a9-9173-48d5-a8a8-4dba2eba64a2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.753813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec812082-8aca-4e06-8e42-ea4152130318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.754443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec812082-8aca-4e06-8e42-ea4152130318 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.754720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec812082-8aca-4e06-8e42-ea4152130318 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.754988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec812082-8aca-4e06-8e42-ea4152130318 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.765563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec812082-8aca-4e06-8e42-ea4152130318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ec812082-8aca-4e06-8e42-ea4152130318 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:39.770332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:39.771202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:39.772055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:39.775749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 161/321] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:39.777225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c18b9-a308-4515-8208-d6aab433f2a5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.880166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c18b9-a308-4515-8208-d6aab433f2a5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:39.906745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670b27-0b47-497e-a0dc-6e94d4db389d None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.907043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670b27-0b47-497e-a0dc-6e94d4db389d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.907298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670b27-0b47-497e-a0dc-6e94d4db389d None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.908942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 162/322] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:39.913619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cc803-37f0-4260-850a-6ec0b14dd039 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.914076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cc803-37f0-4260-850a-6ec0b14dd039 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.914456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cc803-37f0-4260-850a-6ec0b14dd039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.917104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:39.917713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:39.918664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:39.918906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:39.919547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:39.919934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:39.921334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:39.940714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 161/323] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:39.941466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:39.942064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-468cc803-37f0-4260-850a-6ec0b14dd039 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:39.943302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-468cc803-37f0-4260-850a-6ec0b14dd039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:40.000246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.001517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.015294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 163/324] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:40.050882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5f91-1b1d-44f9-9c7e-60109a622044 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.084644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca2b29-0bd5-4f9e-b2db-94301fe6a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.085519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2b29-0bd5-4f9e-b2db-94301fe6a390 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.086006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2b29-0bd5-4f9e-b2db-94301fe6a390 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.086428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2b29-0bd5-4f9e-b2db-94301fe6a390 None admin] PATH_INFO: `/v3/users/3505f95da37545d1affd8928a598cd46` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.087733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca2b29-0bd5-4f9e-b2db-94301fe6a390 None admin] RBAC: Authorizing `identity:get_user(user_id=3505f95da37545d1affd8928a598cd46)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.089308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca2b29-0bd5-4f9e-b2db-94301fe6a390 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.091898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 162/325] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:39 2022] GET /identity/v3/users/3505f95da37545d1affd8928a598cd46 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:40.097661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cc803-37f0-4260-850a-6ec0b14dd039 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.200597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cc803-37f0-4260-850a-6ec0b14dd039 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.223519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f244a-2cda-4856-a830-9cc811237828 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.223819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f244a-2cda-4856-a830-9cc811237828 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.224094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f244a-2cda-4856-a830-9cc811237828 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.225572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 163/326] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:40.230290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003be032-a0e8-4973-b32e-43c651b9b747 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.230578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003be032-a0e8-4973-b32e-43c651b9b747 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.231463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003be032-a0e8-4973-b32e-43c651b9b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.236877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.237491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.237964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.238241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.239920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] RBAC: Adding query filter params (role.id=128a48837255468393c85bbc27310c38, user.id=3505f95da37545d1affd8928a598cd46, scope.system=all) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:40.240391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.241888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.250708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-003be032-a0e8-4973-b32e-43c651b9b747 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:40.252155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-003be032-a0e8-4973-b32e-43c651b9b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:40.254411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 164/327] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/role_assignments?user.id=3505f95da37545d1affd8928a598cd46&scope.system=all&role.id=128a48837255468393c85bbc27310c38 => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.281765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.335224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.339583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 164/328] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:40.432044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52497a-ec3b-426b-9dd9-f8d46b7570a3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.472451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.473035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.473312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.473590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.474692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.476174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.477740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 165/329] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:40.483586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003be032-a0e8-4973-b32e-43c651b9b747 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.535520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.582273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003be032-a0e8-4973-b32e-43c651b9b747 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.605677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.624853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.625492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.625773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.626047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] PATH_INFO: `/v3/groups` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.626678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.628172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.714524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc90019-d551-4d2f-9263-b2d5135dff3a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.728318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.743708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 165/330] 10.222.0.62 () {60 vars in 1134 bytes} [Thu Aug 18 20:33:40 2022] POST /identity/v3/groups => generated 226 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:33:40.751675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.752335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.753801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.753801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.766202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:40.771265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:40.772449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:40.773300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 166/331] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:40.778986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:40.931431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b84983-c7e0-44f6-a916-ef6ad3dee388 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:40.945233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:40.966259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:40.966869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:40.967154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:40.967464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:40.968135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:40.968439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:40.969826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:40.979864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 166/332] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:40.985101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.114917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685a5b-1cda-46f3-99b4-1c1ccc822101 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.169224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c6616-c1cb-4630-80a1-400474ce93fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.170154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6616-c1cb-4630-80a1-400474ce93fd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.170580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6616-c1cb-4630-80a1-400474ce93fd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.171007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6616-c1cb-4630-80a1-400474ce93fd None admin] PATH_INFO: `/v3/users/26b81b78f2e84bee904f0da98a0457cf` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.172238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c6616-c1cb-4630-80a1-400474ce93fd None admin] RBAC: Authorizing `identity:get_user(user_id=26b81b78f2e84bee904f0da98a0457cf)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.173862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c6616-c1cb-4630-80a1-400474ce93fd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.175772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 167/333] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:40 2022] GET /identity/v3/users/26b81b78f2e84bee904f0da98a0457cf => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:41.183731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:41.294033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61b32c-df9c-416d-b4da-b77e9ebee8bb None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:41.333108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c02c46-cf02-4e81-9174-0aaa260d88bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:41.333777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c02c46-cf02-4e81-9174-0aaa260d88bd None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:41.334064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c02c46-cf02-4e81-9174-0aaa260d88bd None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:41.334317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c02c46-cf02-4e81-9174-0aaa260d88bd None admin] PATH_INFO: `/v3/system/users/26b81b78f2e84bee904f0da98a0457cf/roles/94d0c05b1d80413ea118bcce4ed86faf` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:41.335801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c02c46-cf02-4e81-9174-0aaa260d88bd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=26b81b78f2e84bee904f0da98a0457cf, role_id=94d0c05b1d80413ea118bcce4ed86faf)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:41.337233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c02c46-cf02-4e81-9174-0aaa260d88bd None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:41.417104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 167/334] 10.222.0.62 () {58 vars in 1334 bytes} [Thu Aug 18 20:33:41 2022] PUT /identity/v3/system/users/26b81b78f2e84bee904f0da98a0457cf/roles/94d0c05b1d80413ea118bcce4ed86faf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:43.012082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667029-664e-42c1-bf50-18eebcac62fd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.012593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667029-664e-42c1-bf50-18eebcac62fd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.012695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667029-664e-42c1-bf50-18eebcac62fd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.014563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 168/335] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:43.026019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e33a-445d-46b5-844b-b9728a939200 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.026501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e33a-445d-46b5-844b-b9728a939200 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.026574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e33a-445d-46b5-844b-b9728a939200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.048930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a6b8e33a-445d-46b5-844b-b9728a939200 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:43.050392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a6b8e33a-445d-46b5-844b-b9728a939200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:43.083254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.124726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 168/336] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:43.173883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2da59-7390-4261-ba9c-3589b5ff50af None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.174197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2da59-7390-4261-ba9c-3589b5ff50af None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.174430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2da59-7390-4261-ba9c-3589b5ff50af None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.176007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 169/337] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:43.181518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a8ea9-1f67-4fa7-8246-d28a65534fe5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.181800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a8ea9-1f67-4fa7-8246-d28a65534fe5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.182073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a8ea9-1f67-4fa7-8246-d28a65534fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.200863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-293a8ea9-1f67-4fa7-8246-d28a65534fe5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:43.202052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-293a8ea9-1f67-4fa7-8246-d28a65534fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:43.277877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 169/338] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:43.444419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2da59-7390-4261-ba9c-3589b5ff50af None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.498475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.564389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2da59-7390-4261-ba9c-3589b5ff50af None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.596879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a8ea9-1f67-4fa7-8246-d28a65534fe5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.609554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.610202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.610484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.610757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.628088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:43.633772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:43.634639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:43.635450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:43.638819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 170/339] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:43.641877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.809796 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c61d1c-c9b0-4425-93dc-e5fa3285f69e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.811403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.828883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:43.838111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a8ea9-1f67-4fa7-8246-d28a65534fe5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:43.873010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.873646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.873929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.874204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.874885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:43.875191 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:43.876614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:43.883076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:43.883808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:43.884091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:43.884488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:43.895201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 171/340] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:43.900819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:43.904715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:43.907602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:43.908504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:43.909381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 170/341] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:43.914542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.077760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b0633-7e7e-4981-8958-ab1949dd7312 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.127305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e898c-bb73-4177-8452-cb13a4c6bcc4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.133577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc521be-e258-44a2-8ac9-8ae0f1ef11d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.134415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc521be-e258-44a2-8ac9-8ae0f1ef11d7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.134855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc521be-e258-44a2-8ac9-8ae0f1ef11d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.135269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc521be-e258-44a2-8ac9-8ae0f1ef11d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.176913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.197474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.198090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.198371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.198647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.200027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:44.200336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.201751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.220339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 171/342] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:44.226122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.231437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc521be-e258-44a2-8ac9-8ae0f1ef11d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.233142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc521be-e258-44a2-8ac9-8ae0f1ef11d7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.283500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.395202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 172/343] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:44.396463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a39b2d-7d4e-46c2-9d70-96d7366bd7a4 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.396748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a39b2d-7d4e-46c2-9d70-96d7366bd7a4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.397023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a39b2d-7d4e-46c2-9d70-96d7366bd7a4 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.398286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 173/344] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:44.399788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a39b2d-7d4e-46c2-9d70-96d7366bd7a4 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.405272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70811d1-f158-4696-9cb3-5456db72ffb6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.480672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.482272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48107d3-a8d0-4cb0-9ae8-e0b2d7c23c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.483086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48107d3-a8d0-4cb0-9ae8-e0b2d7c23c55 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.483547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48107d3-a8d0-4cb0-9ae8-e0b2d7c23c55 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.483998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48107d3-a8d0-4cb0-9ae8-e0b2d7c23c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.528041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a39b2d-7d4e-46c2-9d70-96d7366bd7a4 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.571676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f76740-5064-4a56-b691-3c360bb90376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.572465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f76740-5064-4a56-b691-3c360bb90376 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.572893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f76740-5064-4a56-b691-3c360bb90376 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.573180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f76740-5064-4a56-b691-3c360bb90376 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.574860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f76740-5064-4a56-b691-3c360bb90376 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.576562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f76740-5064-4a56-b691-3c360bb90376 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.579282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 174/345] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:44.580165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48107d3-a8d0-4cb0-9ae8-e0b2d7c23c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.580445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34592b-2b4c-4be3-9ed7-bed4d9c5642c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.580731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34592b-2b4c-4be3-9ed7-bed4d9c5642c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.581010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34592b-2b4c-4be3-9ed7-bed4d9c5642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.582302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48107d3-a8d0-4cb0-9ae8-e0b2d7c23c55 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.603354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-be34592b-2b4c-4be3-9ed7-bed4d9c5642c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:44.605437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-be34592b-2b4c-4be3-9ed7-bed4d9c5642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:44.608220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.698713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 175/346] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:44.700326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a5d32-36cc-4c47-9ae9-33ea43f260b2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.700615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a5d32-36cc-4c47-9ae9-33ea43f260b2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.700892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a5d32-36cc-4c47-9ae9-33ea43f260b2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.702156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 176/347] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:44.702857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a5d32-36cc-4c47-9ae9-33ea43f260b2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.721690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 172/348] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:44.723331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f883fa-4c12-4bc8-900c-e06df04c2125 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.723843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f883fa-4c12-4bc8-900c-e06df04c2125 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.724453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f883fa-4c12-4bc8-900c-e06df04c2125 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.726391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 173/349] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:44.727775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce7ee-ebf7-4890-b545-6223d4e318a3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.728339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce7ee-ebf7-4890-b545-6223d4e318a3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.728814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce7ee-ebf7-4890-b545-6223d4e318a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.756107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-12bce7ee-ebf7-4890-b545-6223d4e318a3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:44.757989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-12bce7ee-ebf7-4890-b545-6223d4e318a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:44.774077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:44.817076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a5d32-36cc-4c47-9ae9-33ea43f260b2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:44.848356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 174/350] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:44.849543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bce7ee-ebf7-4890-b545-6223d4e318a3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:44.877488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0893e-e5aa-4800-ab1e-80eb8fa685ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:44.878130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0893e-e5aa-4800-ab1e-80eb8fa685ba None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.878476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0893e-e5aa-4800-ab1e-80eb8fa685ba None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.878745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0893e-e5aa-4800-ab1e-80eb8fa685ba None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.890686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0893e-e5aa-4800-ab1e-80eb8fa685ba None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:44.893479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0893e-e5aa-4800-ab1e-80eb8fa685ba None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:44.895141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 177/351] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:44.896328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d76d1-efff-4bb2-a569-eec9d8a9315d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:44.896607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d76d1-efff-4bb2-a569-eec9d8a9315d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:44.896877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d76d1-efff-4bb2-a569-eec9d8a9315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:44.937634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6f5d76d1-efff-4bb2-a569-eec9d8a9315d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:44.940148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6f5d76d1-efff-4bb2-a569-eec9d8a9315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:44.954227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.035560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bce7ee-ebf7-4890-b545-6223d4e318a3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.054509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 178/352] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:45.055631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d76d1-efff-4bb2-a569-eec9d8a9315d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.081758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.082570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.082858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.083528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.084978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.087103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.089527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 175/353] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:44 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.090320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.160415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.211790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fd3b8-0565-47b0-b955-f753a3bc7086 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.231558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.250763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.251469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.251756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.252058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.265751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:45.269662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d76d1-efff-4bb2-a569-eec9d8a9315d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:45.270418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:45.271340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:45.272193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:45.274978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 176/354] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:45.276001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.315399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.316623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.317111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.317667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.319755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=128a48837255468393c85bbc27310c38, scope.project.id=9eb915d3d58143368864175803663453) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:45.320077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.321548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.331338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 179/355] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=9eb915d3d58143368864175803663453&role.id=128a48837255468393c85bbc27310c38 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.332599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.442473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b246c-102f-4ee5-b9ba-b3e3b38c2633 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.476413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9b381-449b-42f7-8387-39283f257434 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.481812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.482463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.482739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.483007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.484262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.485757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.487861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 177/356] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.488726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.502891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.520650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.521687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.522137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.522576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.536168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:45.541559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:45.542444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:33:45.543887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:45.546256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 180/357] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:45.546831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.547526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.615740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19a2b2-6d33-45dc-83aa-7070ddf312c5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.663217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.664887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.665172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.665451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.666287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:45.666602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.669080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.675427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f36ca-a6f0-4162-85ad-b949d4605150 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.679725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 178/358] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.684418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.729760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.731055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.731799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.732473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.750660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:45.765582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:45.766588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:45.767436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:45.768550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 181/359] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:45.770671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.819754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6cd66-438e-4dcc-a2e4-446594413d05 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.830387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.845320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:45.863240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef815b-5337-4e55-9181-2d120bcc6db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.864280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef815b-5337-4e55-9181-2d120bcc6db3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.864791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef815b-5337-4e55-9181-2d120bcc6db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.865229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef815b-5337-4e55-9181-2d120bcc6db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.866567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef815b-5337-4e55-9181-2d120bcc6db3 None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=9eb915d3d58143368864175803663453) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:45.867112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef815b-5337-4e55-9181-2d120bcc6db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:45.869809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef815b-5337-4e55-9181-2d120bcc6db3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:45.881780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 179/360] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=9eb915d3d58143368864175803663453&role.id=f84356f9eb7648808591d233bb604d18 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:45.884012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f9fd9-f1e3-49e8-8d1c-f283b4357be7 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.884509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f9fd9-f1e3-49e8-8d1c-f283b4357be7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.884991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f9fd9-f1e3-49e8-8d1c-f283b4357be7 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.888855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 180/361] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:45.890333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f9fd9-f1e3-49e8-8d1c-f283b4357be7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:45.929666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a46065-b825-46ff-9298-5b5a066072a5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:45.996734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:45.997354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:45.997638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:45.997912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:45.998996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:45.999311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.001099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.034403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 182/362] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.035021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.077032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f9fd9-f1e3-49e8-8d1c-f283b4357be7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.125310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.126341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.126637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.126919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.184424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.185387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a93a7-f48c-4002-9ae9-1a8ea8f025cb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.186986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.214353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.216574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.224833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d4013-d89b-4e11-b500-b7e8819d811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.225443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d4013-d89b-4e11-b500-b7e8819d811a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.225729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d4013-d89b-4e11-b500-b7e8819d811a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.226029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d4013-d89b-4e11-b500-b7e8819d811a None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.226686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d4013-d89b-4e11-b500-b7e8819d811a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:46.226990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d4013-d89b-4e11-b500-b7e8819d811a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.228448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d4013-d89b-4e11-b500-b7e8819d811a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.237575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 183/363] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.238781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49449f-0c63-40dc-8ce1-7a916521e229 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.239384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49449f-0c63-40dc-8ce1-7a916521e229 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.239384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49449f-0c63-40dc-8ce1-7a916521e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.259452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2f49449f-0c63-40dc-8ce1-7a916521e229 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:46.260817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2f49449f-0c63-40dc-8ce1-7a916521e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:46.328396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 181/364] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:46.329590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.334686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 184/365] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:46.339385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49449f-0c63-40dc-8ce1-7a916521e229 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.439926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.446983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.459397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49449f-0c63-40dc-8ce1-7a916521e229 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.487696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764bece-73b0-48b4-8f21-a249a0fb74b8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.491249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.491967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.492261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.492536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.542972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.543954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.544418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.544870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] PATH_INFO: `/v3/users/26b81b78f2e84bee904f0da98a0457cf` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.548471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] RBAC: Authorizing `identity:get_user(user_id=26b81b78f2e84bee904f0da98a0457cf)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.550235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.552154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 182/366] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/users/26b81b78f2e84bee904f0da98a0457cf => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.553127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.571608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.573150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.680400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.689325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 185/367] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:46.690271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.721340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6f474-ab69-4990-8e25-f255ec976d59 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.801075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.801639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.801844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d32db-2457-4738-8016-ff9c5beeebad None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:46.801946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.802170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.803305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.804780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.806407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 183/368] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.807168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.830628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.841693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:46.842310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:46.842758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:46.842960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:46.843735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] RBAC: Adding query filter params (role.id=94d0c05b1d80413ea118bcce4ed86faf, user.id=26b81b78f2e84bee904f0da98a0457cf, scope.system=all) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:46.844048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:46.845611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:46.859017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 186/369] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/role_assignments?user.id=26b81b78f2e84bee904f0da98a0457cf&scope.system=all&role.id=94d0c05b1d80413ea118bcce4ed86faf => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:46.859976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:46.921945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:46.980981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff8a2-9bac-410d-aef8-73ab6bc4ca9b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.028070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.028724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.029010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.029287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.030445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.031940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.034636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 187/370] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:47.035575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.065405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293264e1-1965-44a5-9b58-a777c8d3ce89 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.143922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.144569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.144844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.145113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.146243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.147700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.149619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 184/371] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:46 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:47.150460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.181335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493af95-d2e1-45ca-a807-190586d7d576 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.209966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.231204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.232710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.232995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.233270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.250742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:47.256125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:47.260111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:47.261065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:47.261938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:47.265586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 188/372] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:47.266802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.285626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d5d33-3020-47b4-8c3e-d233d8a26477 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.332304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.332844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.333125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.333539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.334291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=128a48837255468393c85bbc27310c38, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:47.334604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.336161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.342411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 185/373] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=128a48837255468393c85bbc27310c38 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:47.356308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.399697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827e4c8-aaed-4a6b-8ba3-f895cc2fc281 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.436647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.437717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.438277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.438770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.440407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.442117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.444286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 189/374] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:47.449997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.471612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c951bc3-ad5f-42eb-89fc-16d50c80658c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.515036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.515719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.516007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.516118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.516294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.517127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:47.517328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.518844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.528557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 186/375] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:47.533740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.537029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.583820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbab1a2-36eb-4424-bd56-097b887f88c1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.631829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d8c70-6400-437c-82ea-aaafb7ab67da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.633103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8c70-6400-437c-82ea-aaafb7ab67da None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.633576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8c70-6400-437c-82ea-aaafb7ab67da None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.634041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8c70-6400-437c-82ea-aaafb7ab67da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.635134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d8c70-6400-437c-82ea-aaafb7ab67da None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:47.636049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d8c70-6400-437c-82ea-aaafb7ab67da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.638837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d8c70-6400-437c-82ea-aaafb7ab67da None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.650283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 190/376] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=f84356f9eb7648808591d233bb604d18 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:47.666939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcba05-4262-4ad5-9e42-9d174705144a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:47.711141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:47.711802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.712089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.712367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.797803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:47.799331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:47.801650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:47.828217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1a6c3-6066-497b-8905-c54623b35d91 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.828846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1a6c3-6066-497b-8905-c54623b35d91 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.829321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1a6c3-6066-497b-8905-c54623b35d91 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.831140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 191/377] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:47.837653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb66c5-0292-4108-b855-10835f1f339b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:47.838300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb66c5-0292-4108-b855-10835f1f339b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:47.838788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb66c5-0292-4108-b855-10835f1f339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:47.862325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b3bb66c5-0292-4108-b855-10835f1f339b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:47.863929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b3bb66c5-0292-4108-b855-10835f1f339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:47.913517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 187/378] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:47.919426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:47.942631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 192/379] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:48.041948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6f838-e0e8-4b65-aac4-ecb3f22b5ab3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.043964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:48.081219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.081877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.082157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.082430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] PATH_INFO: `/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.083833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e6113ebebf7b4a1a9829f6a6a5263233)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.085412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.087160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 188/380] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:47 2022] GET /identity/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:48.093450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb66c5-0292-4108-b855-10835f1f339b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:48.164745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:48.233825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb66c5-0292-4108-b855-10835f1f339b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.271007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.272061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.272551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.273025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] PATH_INFO: `/v3/groups/8d7414808fb5424489f7f450aeefb4b6` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.279301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7414808fb5424489f7f450aeefb4b6)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.281082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.282986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 193/381] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:48 2022] GET /identity/v3/groups/8d7414808fb5424489f7f450aeefb4b6 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:48.289103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:48.360649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:48.435509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a067d-41c6-40ba-ab1e-5b475b4751f5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.482954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067a871-968e-410d-addd-9ea276eca555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.484009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a871-968e-410d-addd-9ea276eca555 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.484503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a871-968e-410d-addd-9ea276eca555 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.484981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a871-968e-410d-addd-9ea276eca555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.485937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067a871-968e-410d-addd-9ea276eca555 None admin] RBAC: Adding query filter params (group.id=8d7414808fb5424489f7f450aeefb4b6, role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=e6113ebebf7b4a1a9829f6a6a5263233) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:48.486458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067a871-968e-410d-addd-9ea276eca555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.488204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067a871-968e-410d-addd-9ea276eca555 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.494775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 189/382] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:48 2022] GET /identity/v3/role_assignments?group.id=8d7414808fb5424489f7f450aeefb4b6&scope.project.id=e6113ebebf7b4a1a9829f6a6a5263233&role.id=5eebc7f04cfc4979a378bf94830482af => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:48.496606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa39a-a297-4b6c-8aca-00442be2f350 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.497248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60c5f-5d34-4389-9c97-3fd15444f570 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.497794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60c5f-5d34-4389-9c97-3fd15444f570 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.498263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60c5f-5d34-4389-9c97-3fd15444f570 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.500174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 190/383] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:48.507403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:48.508292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83622-3a8f-48ad-9946-e1fe6eeed252 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.508579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83622-3a8f-48ad-9946-e1fe6eeed252 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.508854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83622-3a8f-48ad-9946-e1fe6eeed252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.544972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.545628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.545911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.546185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.560037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-64f83622-3a8f-48ad-9946-e1fe6eeed252 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:48.561283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-64f83622-3a8f-48ad-9946-e1fe6eeed252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:48.571131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:48.576535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:48.577454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:48.578229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 194/384] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:48.584302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:48.621416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:48.693184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 191/385] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:48.739886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832892c0-48d4-4a51-9ce0-fc9c0ee620dc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.779481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.780107 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.780392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.780671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.781345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:48.781655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:48.783036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:48.797439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 195/386] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:48.798870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83622-3a8f-48ad-9946-e1fe6eeed252 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:48.946640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83622-3a8f-48ad-9946-e1fe6eeed252 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:48.997599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:48.998255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:48.998535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:48.998805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:48.999976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.001425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.003308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 192/387] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:48 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:49.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.008917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.043962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.045811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.129752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db9f32-dd26-4aac-a599-a99c25d67c85 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.135703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172ea89-6c0e-46f1-b039-6616d286419a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.172772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.173418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.173746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.174017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.175329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.175989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.176264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.176532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.180127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.184310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.187326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 196/388] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:49.192760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.196447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:49.207507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:49.208447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:49.209241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 193/389] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:49.218396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.341090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.354853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f61030-32ea-4567-a392-a724d9d4ab66 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.386599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.394893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb0a0-2a0a-4422-8cd7-f57a66a458ba None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.410811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.411442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.411721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.411991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.412666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:49.412969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.414356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.424011 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 194/390] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:49.430958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.443935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.444615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.444894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.445169 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.447172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9eb915d3d58143368864175803663453, group_id=3e272ed9c1da4f2d90e1dc97faa0c62b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.448677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.530759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 197/391] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Aug 18 20:33:49 2022] PUT /identity/v3/projects/9eb915d3d58143368864175803663453/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:49.554413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5a320-e526-4e4f-a5b9-5fa996dbe25a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.596250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.596901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.597180 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.597448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.598608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.600117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.602050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 195/392] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:49.608697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.751562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780702f6-e687-4212-ab8e-60fc4123d9b7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.794349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec2d67-bcf7-46ff-9a8c-46b8cc2940c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.795009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec2d67-bcf7-46ff-9a8c-46b8cc2940c5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.795296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec2d67-bcf7-46ff-9a8c-46b8cc2940c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.795595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec2d67-bcf7-46ff-9a8c-46b8cc2940c5 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.796949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec2d67-bcf7-46ff-9a8c-46b8cc2940c5 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.798428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec2d67-bcf7-46ff-9a8c-46b8cc2940c5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:49.800492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 198/393] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:49 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:49.806528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:49.833748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:49.915114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b0cb-e77d-4c94-9083-1ca1eb9c1aae None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:49.950129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63b60a-1c5c-4a7b-a26e-c74351318ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:49.950788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63b60a-1c5c-4a7b-a26e-c74351318ac1 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:49.951066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63b60a-1c5c-4a7b-a26e-c74351318ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:49.951336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63b60a-1c5c-4a7b-a26e-c74351318ac1 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:49.953540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63b60a-1c5c-4a7b-a26e-c74351318ac1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9eb915d3d58143368864175803663453, group_id=3e272ed9c1da4f2d90e1dc97faa0c62b, role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:49.955053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63b60a-1c5c-4a7b-a26e-c74351318ac1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:50.028967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 196/394] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Aug 18 20:33:49 2022] PUT /identity/v3/projects/9eb915d3d58143368864175803663453/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/f84356f9eb7648808591d233bb604d18 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:33:50.222039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d318c5-203a-4df5-9105-b0fd6aada5e9 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.222381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d318c5-203a-4df5-9105-b0fd6aada5e9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.222485 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d318c5-203a-4df5-9105-b0fd6aada5e9 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.224239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 199/395] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:50.229588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6550d3-abed-4bcb-aaf6-f31a06a3d4e3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.230256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6550d3-abed-4bcb-aaf6-f31a06a3d4e3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.230759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6550d3-abed-4bcb-aaf6-f31a06a3d4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.254732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7b6550d3-abed-4bcb-aaf6-f31a06a3d4e3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:50.256416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7b6550d3-abed-4bcb-aaf6-f31a06a3d4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:50.344710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 197/396] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:50.374945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db746bf-0081-46a3-b72f-efc84dcfdd9c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.375227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db746bf-0081-46a3-b72f-efc84dcfdd9c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.375549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db746bf-0081-46a3-b72f-efc84dcfdd9c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.377149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 200/397] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:50.388751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9c8f2-1fb9-4b75-a9c9-5e08cb8559b8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.389300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9c8f2-1fb9-4b75-a9c9-5e08cb8559b8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.389732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9c8f2-1fb9-4b75-a9c9-5e08cb8559b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.428557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a7f9c8f2-1fb9-4b75-a9c9-5e08cb8559b8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:50.429990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a7f9c8f2-1fb9-4b75-a9c9-5e08cb8559b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:50.441384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:50.514663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 198/398] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:50.804643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db746bf-0081-46a3-b72f-efc84dcfdd9c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:50.835735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:50.924182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db746bf-0081-46a3-b72f-efc84dcfdd9c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:50.968963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:50.969672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:50.969958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:50.970238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:50.983453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:50.988439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:50.989382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:50.990164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:50.990760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 201/399] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:50.996584 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9c8f2-1fb9-4b75-a9c9-5e08cb8559b8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.031482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.129571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.133830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9c8f2-1fb9-4b75-a9c9-5e08cb8559b8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.156950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5b34-5ec7-4f89-989b-c99e41138b7f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.172148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.172755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.173028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.173295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.173969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:51.174269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.175655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.184528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 199/400] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:51.189976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.193726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.225410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.226058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.226346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.226625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.255296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:51.264654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:51.265524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:51.266320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 202/401] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:51.272015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.292218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c33acb-5e80-46ce-945a-97472ca26aa1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.326597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.327245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.327559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.327837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.329085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.330595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.332520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 200/402] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:51.337814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.410277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.441313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126baf07-9316-4574-ac55-f3fe55c81c90 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.478879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d99f-9fbd-4fa1-839e-d5759a1d37df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.479537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d99f-9fbd-4fa1-839e-d5759a1d37df None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.479815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d99f-9fbd-4fa1-839e-d5759a1d37df None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.480149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d99f-9fbd-4fa1-839e-d5759a1d37df None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.481273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085d99f-9fbd-4fa1-839e-d5759a1d37df None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.482703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085d99f-9fbd-4fa1-839e-d5759a1d37df None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.484664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 201/403] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:51.485778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3b3f-95d4-4505-a5d8-351620c2b050 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.486054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3b3f-95d4-4505-a5d8-351620c2b050 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.486321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3b3f-95d4-4505-a5d8-351620c2b050 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.491907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011039-7c20-4060-9655-0d75ecd032ff None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.492249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 202/404] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:51.492987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3b3f-95d4-4505-a5d8-351620c2b050 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.531302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0cbba-fed0-4a81-b64e-92ad5567008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.531977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0cbba-fed0-4a81-b64e-92ad5567008f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.532315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0cbba-fed0-4a81-b64e-92ad5567008f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.532640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0cbba-fed0-4a81-b64e-92ad5567008f None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.533312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0cbba-fed0-4a81-b64e-92ad5567008f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:51.533613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0cbba-fed0-4a81-b64e-92ad5567008f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.535056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0cbba-fed0-4a81-b64e-92ad5567008f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.544176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 203/405] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:51.545461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742688-41bf-400d-86e4-a7789f064e3c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.545746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742688-41bf-400d-86e4-a7789f064e3c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.546065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742688-41bf-400d-86e4-a7789f064e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.563788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.565736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-db742688-41bf-400d-86e4-a7789f064e3c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:51.567031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-db742688-41bf-400d-86e4-a7789f064e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:51.605727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3b3f-95d4-4505-a5d8-351620c2b050 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.640252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.640913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.641191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.641463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.641978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 204/406] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:51.642959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db742688-41bf-400d-86e4-a7789f064e3c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.652663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] RBAC: Authorizing `identity:create_grant(project_id=3609b26ed3b7446caca874a5e0c4d89f, group_id=3e272ed9c1da4f2d90e1dc97faa0c62b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.654165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.745385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db742688-41bf-400d-86e4-a7789f064e3c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.781009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.781638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.781914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.782183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.783323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.794430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.794618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.794618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 205/407] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:51.794618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.796904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:51.797906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 203/408] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Aug 18 20:33:51 2022] PUT /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:51.902162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb11f5e-a43f-434f-a792-b1c78a9a2174 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:51.938907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f992-3139-4588-bdd6-0fa9e8278ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:51.939623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f992-3139-4588-bdd6-0fa9e8278ead None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.939904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f992-3139-4588-bdd6-0fa9e8278ead None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.940175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f992-3139-4588-bdd6-0fa9e8278ead None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.941451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f992-3139-4588-bdd6-0fa9e8278ead None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:51.942972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f992-3139-4588-bdd6-0fa9e8278ead None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:51.945025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 206/409] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:51 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:51.951186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:51.953536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656dfed-7366-4f8f-a525-6e5027866963 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.954043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656dfed-7366-4f8f-a525-6e5027866963 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.954932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656dfed-7366-4f8f-a525-6e5027866963 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.956719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 207/410] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:51.962763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b44a7-dbf4-48f5-acbe-558998652951 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:51.963045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b44a7-dbf4-48f5-acbe-558998652951 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:51.963324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b44a7-dbf4-48f5-acbe-558998652951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:51.993246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-247b44a7-dbf4-48f5-acbe-558998652951 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:51.997964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-247b44a7-dbf4-48f5-acbe-558998652951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:52.084566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 208/411] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:33:52.085537 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b44a7-dbf4-48f5-acbe-558998652951 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.088989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.104436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebbe5a-60e9-441a-b94e-d45c531f555c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.177604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.178659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.179149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.179642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.187428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] RBAC: Authorizing `identity:create_grant(project_id=3609b26ed3b7446caca874a5e0c4d89f, group_id=3e272ed9c1da4f2d90e1dc97faa0c62b, role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.189148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.241476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b44a7-dbf4-48f5-acbe-558998652951 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.276394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.277911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.278393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.280865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.285670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 204/412] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Aug 18 20:33:51 2022] PUT /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f/groups/3e272ed9c1da4f2d90e1dc97faa0c62b/roles/f84356f9eb7648808591d233bb604d18 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:33:52.298297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:52.303721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:52.304731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:52.305500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:52.308002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 209/413] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:52.313423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.415713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.454029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.477807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6646bb-64ca-408c-b099-6ac298e53551 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.518128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ee292-c877-4138-a329-61aa38a2f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.518742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee292-c877-4138-a329-61aa38a2f88c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.519073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee292-c877-4138-a329-61aa38a2f88c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.519381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee292-c877-4138-a329-61aa38a2f88c None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.520251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ee292-c877-4138-a329-61aa38a2f88c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:52.520564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ee292-c877-4138-a329-61aa38a2f88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.521947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ee292-c877-4138-a329-61aa38a2f88c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.533775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.541615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 205/414] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:52.541615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b39f-27d2-4b51-a390-faad0c4e70d1 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.541615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b39f-27d2-4b51-a390-faad0c4e70d1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.541615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b39f-27d2-4b51-a390-faad0c4e70d1 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.542750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 206/415] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:52.545382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153b39f-27d2-4b51-a390-faad0c4e70d1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.587275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db628d-4190-4e6d-89d8-680e490c0dc6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.634488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd395f9-427d-4372-89b1-6556d4a85dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.635164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd395f9-427d-4372-89b1-6556d4a85dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.635479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd395f9-427d-4372-89b1-6556d4a85dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.635761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd395f9-427d-4372-89b1-6556d4a85dd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.650586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd395f9-427d-4372-89b1-6556d4a85dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8fd395f9-427d-4372-89b1-6556d4a85dd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:52.658477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:52.661841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:52.662613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 210/416] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:52.666237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcae2-a77e-4862-a437-9fafaa789aae None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.666558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcae2-a77e-4862-a437-9fafaa789aae None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.666846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcae2-a77e-4862-a437-9fafaa789aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.680921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153b39f-27d2-4b51-a390-faad0c4e70d1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.692162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-833bcae2-a77e-4862-a437-9fafaa789aae None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:52.694790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-833bcae2-a77e-4862-a437-9fafaa789aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:52.716394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.737155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.738079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.738369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.738648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] PATH_INFO: `/v3/groups/8d7414808fb5424489f7f450aeefb4b6` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.740179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7414808fb5424489f7f450aeefb4b6)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.742339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.743955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 207/417] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/groups/8d7414808fb5424489f7f450aeefb4b6 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:52.748627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.792642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 211/418] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:52.799967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bcae2-a77e-4862-a437-9fafaa789aae None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:52.878490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:52.935389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc75302-1793-4062-acc0-bbc5f43a50f9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.935583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bcae2-a77e-4862-a437-9fafaa789aae None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:52.984854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.986029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.986585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.987166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] PATH_INFO: `/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.994411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] RBAC: Authorizing `identity:get_project(project_id=e6113ebebf7b4a1a9829f6a6a5263233)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:52.996426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:52.997294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:52.997771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:52.997889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:52.998359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:52.999325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:52.999844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.001425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.008001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 212/419] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:53.015568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.029632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 208/420] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:53.036377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.099813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.148319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda732b8-7f23-4e49-8867-8b03a52e78d4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.189023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d852-3680-4755-bfd0-ae30dfff5183 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.190197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.191142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.191696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.192165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.215917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.230807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.232250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.232250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.232250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] PATH_INFO: `/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233/groups/8d7414808fb5424489f7f450aeefb4b6/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.234080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] RBAC: Authorizing `identity:create_grant(project_id=e6113ebebf7b4a1a9829f6a6a5263233, group_id=8d7414808fb5424489f7f450aeefb4b6, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.235559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.270351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.272179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.325473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.351530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 213/421] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Aug 18 20:33:53 2022] PUT /identity/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233/groups/8d7414808fb5424489f7f450aeefb4b6/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:33:53.351530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.447325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 209/422] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:53.454020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.500607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573d152-e5d2-4732-aeb2-f30f8deed41e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.542796 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.543534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.543815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.544080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.557950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:53.564911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:53.565829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:53.566617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:33:53.567492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 214/423] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:53.573380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.629255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.648802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef254ab-41d4-47e2-9898-59460d1643f4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.693637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.694278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.694607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.694893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.696941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.698479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.700581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 210/424] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:53.706019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857d4a-647f-4e19-9bc4-f0421958962b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.707054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.743130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.751118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.751758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.752181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.752598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.753328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:53.753787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:53.755180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:53.765645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 215/425] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:53.771254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:53.889198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af16cd-d3c2-4631-9521-14a8be0eb0eb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:53.890686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:53.928319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5042d-ae74-4f15-86fd-d02f1d68c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:53.928926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5042d-ae74-4f15-86fd-d02f1d68c597 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:53.929210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5042d-ae74-4f15-86fd-d02f1d68c597 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:53.929480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5042d-ae74-4f15-86fd-d02f1d68c597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:53.938185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe71a39-4b7c-4ad1-b9b9-b81a7a964baf None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.009916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5042d-ae74-4f15-86fd-d02f1d68c597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.011897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5042d-ae74-4f15-86fd-d02f1d68c597 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.021294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eff0b9-3f59-4618-b84b-2e3a19b8aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.021954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eff0b9-3f59-4618-b84b-2e3a19b8aa2f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.022238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eff0b9-3f59-4618-b84b-2e3a19b8aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.022514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eff0b9-3f59-4618-b84b-2e3a19b8aa2f None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.028228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eff0b9-3f59-4618-b84b-2e3a19b8aa2f None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.029779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eff0b9-3f59-4618-b84b-2e3a19b8aa2f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.031767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 211/426] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.033262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f61e80-5056-46eb-a36e-70144fa2e4c1 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.033551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f61e80-5056-46eb-a36e-70144fa2e4c1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.033828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f61e80-5056-46eb-a36e-70144fa2e4c1 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.035033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 212/427] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:54.037121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f61e80-5056-46eb-a36e-70144fa2e4c1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.146924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.160611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 216/428] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:54.161940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd736-eabe-4dd6-aa0b-d6fc97b386da None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.162213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f61e80-5056-46eb-a36e-70144fa2e4c1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.162320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd736-eabe-4dd6-aa0b-d6fc97b386da None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.162493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd736-eabe-4dd6-aa0b-d6fc97b386da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.169883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.185560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-932cd736-eabe-4dd6-aa0b-d6fc97b386da None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:54.186783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-932cd736-eabe-4dd6-aa0b-d6fc97b386da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:54.205146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.206099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.206600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.207092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.208101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=128a48837255468393c85bbc27310c38, scope.project.id=9eb915d3d58143368864175803663453) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:54.208831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.210545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.222294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 213/429] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=9eb915d3d58143368864175803663453&role.id=128a48837255468393c85bbc27310c38 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.223645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.285889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 217/430] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:54.348987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0039258-0fef-42ad-bf11-a131bfeadb82 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.390345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cb321-8cae-46ff-af0a-df0d1089ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.390995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb321-8cae-46ff-af0a-df0d1089ce13 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.391275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb321-8cae-46ff-af0a-df0d1089ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.391573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb321-8cae-46ff-af0a-df0d1089ce13 None admin] PATH_INFO: `/v3/projects/9eb915d3d58143368864175803663453` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.396147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cb321-8cae-46ff-af0a-df0d1089ce13 None admin] RBAC: Authorizing `identity:get_project(project_id=9eb915d3d58143368864175803663453)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.397674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cb321-8cae-46ff-af0a-df0d1089ce13 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.399629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 214/431] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/projects/9eb915d3d58143368864175803663453 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.404853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd736-eabe-4dd6-aa0b-d6fc97b386da None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.483107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5edd57-9ab9-4ad6-a8b3-3c30d8fcf8cd None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.483647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5edd57-9ab9-4ad6-a8b3-3c30d8fcf8cd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.483729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5edd57-9ab9-4ad6-a8b3-3c30d8fcf8cd None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.485006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 215/432] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:54.490149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe09419-00d2-4c3e-992f-9c94090e4678 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.490435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe09419-00d2-4c3e-992f-9c94090e4678 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.490708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe09419-00d2-4c3e-992f-9c94090e4678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.514731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd736-eabe-4dd6-aa0b-d6fc97b386da None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.518065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8fe09419-00d2-4c3e-992f-9c94090e4678 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:54.519251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8fe09419-00d2-4c3e-992f-9c94090e4678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:54.537002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.559039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.564148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.564784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.567950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.567950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.567950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.567950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.569819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 218/433] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.576055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.614062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 216/434] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:54.631833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe09419-00d2-4c3e-992f-9c94090e4678 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.717374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84249-a268-46e7-be67-9934d809a335 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.757255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe09419-00d2-4c3e-992f-9c94090e4678 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.776469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.777232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.777550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.777896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.778714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=9eb915d3d58143368864175803663453) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:54.779085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:54.780638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:54.787237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 219/435] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=9eb915d3d58143368864175803663453&role.id=f84356f9eb7648808591d233bb604d18 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:54.805252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.806195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.806624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.807044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.820573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:54.826619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:54.827868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:33:54.828874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:54.831188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 217/436] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:33:54.837290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.914344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.956443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:54.958292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba43a-ca18-4796-bc05-95394a391bfa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:54.971284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:54.996741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:54.997476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:54.997762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:54.998037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:54.998714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] RBAC: Adding query filter params (name=member) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:54.999021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.000430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.012539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 220/437] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.018754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.074295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5ed53-3663-4ea7-9bfb-bae1109e70b0 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.141356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.144331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.144331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.144331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.157001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacc28-95cb-4a66-921d-eff73568beca None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.158164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:55.166322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:55.167252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:55.168198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 218/438] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:33:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:55.176053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.200541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.210932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.216675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.216675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.216675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.270489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.302780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.304305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.314424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f73bc-4627-4542-8784-78d327c4b3c7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.360045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.360653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.360930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.361188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.361856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:55.362157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.363579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.373156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 219/439] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.378689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.426420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 221/440] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:55.432431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.461659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.488208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3d4a-5354-4011-9dd9-5070b4d75f51 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.523965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.529802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28cde-bdbf-40a8-8a4b-b571bb0054e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.530406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28cde-bdbf-40a8-8a4b-b571bb0054e9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.530811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28cde-bdbf-40a8-8a4b-b571bb0054e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.531246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28cde-bdbf-40a8-8a4b-b571bb0054e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.548504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a222a-f879-495a-8375-03f2f7e688c1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.587299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.587972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.588260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.588508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.589835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.591301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.593272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 222/441] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.598910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.613515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28cde-bdbf-40a8-8a4b-b571bb0054e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.614980 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28cde-bdbf-40a8-8a4b-b571bb0054e9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.708705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.715637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3062-91e5-45d5-a15b-4addd3c33129 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.738467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 220/442] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:33:55.742248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946eb04-7a2b-4ea3-9c95-aab9c17e9421 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.742605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946eb04-7a2b-4ea3-9c95-aab9c17e9421 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.742951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946eb04-7a2b-4ea3-9c95-aab9c17e9421 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.744346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 221/443] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:33:55.745130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946eb04-7a2b-4ea3-9c95-aab9c17e9421 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.758434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00e926-8848-423f-aa7d-b990165e1f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.759061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e926-8848-423f-aa7d-b990165e1f0b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e926-8848-423f-aa7d-b990165e1f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.759640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e926-8848-423f-aa7d-b990165e1f0b None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.760752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00e926-8848-423f-aa7d-b990165e1f0b None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.762244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00e926-8848-423f-aa7d-b990165e1f0b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.764123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 223/444] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:55.765352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51a7c-6fa0-446d-a921-60b39f9c155f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.765619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51a7c-6fa0-446d-a921-60b39f9c155f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.765887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51a7c-6fa0-446d-a921-60b39f9c155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.786528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1ca51a7c-6fa0-446d-a921-60b39f9c155f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:55.787581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.787744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1ca51a7c-6fa0-446d-a921-60b39f9c155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:55.861282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 224/445] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:55.862023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca51a7c-6fa0-446d-a921-60b39f9c155f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.880096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946eb04-7a2b-4ea3-9c95-aab9c17e9421 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:55.919212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:55.920012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:55.920287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:55.920819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] PATH_INFO: `/v3/projects/3609b26ed3b7446caca874a5e0c4d89f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:55.921729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] RBAC: Authorizing `identity:get_project(project_id=3609b26ed3b7446caca874a5e0c4d89f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:55.923183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:55.925046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 222/446] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/projects/3609b26ed3b7446caca874a5e0c4d89f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:55.930115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:55.972665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:55.981832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca51a7c-6fa0-446d-a921-60b39f9c155f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:56.018236 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:56.018864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:56.023534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:56.023534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:56.023534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=128a48837255468393c85bbc27310c38, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:56.023534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:56.023534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:56.028517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 225/447] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=128a48837255468393c85bbc27310c38 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:56.056383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:56.060162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8f079-5b32-47c8-9dbe-a0a5673bc9ab None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:56.100916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:56.101603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:56.101919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:56.102191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] PATH_INFO: `/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:56.103384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] RBAC: Authorizing `identity:get_group(group_id=3e272ed9c1da4f2d90e1dc97faa0c62b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:56.105436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:56.107230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 223/448] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:55 2022] GET /identity/v3/groups/3e272ed9c1da4f2d90e1dc97faa0c62b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:33:56.113017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:56.193138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:56.234621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2a0cd-ea12-4ed2-8912-6285f288aa97 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:56.273227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:56.273843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:56.274124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:56.274401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:56.275138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] RBAC: Adding query filter params (group.id=3e272ed9c1da4f2d90e1dc97faa0c62b, role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=3609b26ed3b7446caca874a5e0c4d89f) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:56.275529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:56.277545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:56.284054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 226/449] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:56 2022] GET /identity/v3/role_assignments?group.id=3e272ed9c1da4f2d90e1dc97faa0c62b&scope.project.id=3609b26ed3b7446caca874a5e0c4d89f&role.id=f84356f9eb7648808591d233bb604d18 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:56.319145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25821282-be04-4f4c-8535-1d301edb3ab4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:56.365252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:56.365899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:56.366182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:56.366456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:56.380050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:33:56.384988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:33:56.385905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:33:56.386756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 224/450] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:33:56.393828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:56.422650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:56.512267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e919-ad6c-499d-8d2b-75feea4e3dcc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:56.546927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:56.547564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:56.547845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:56.548116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:56.548788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:56.549091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:56.550467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:56.559196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 227/451] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:56.565002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:56.597730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:56.671133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517e0a-669c-4a91-85e3-7ad2bd87d97b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:56.702951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:56.703574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:56.703851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:56.704118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:56.768540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:56.770045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:56.796561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:56.864265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 225/452] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:33:56.870260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:56.951355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:56.968984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af6551-3a65-4120-b6b3-dd79d9bd45ce None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.001554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.002166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.002448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.002724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] PATH_INFO: `/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.003904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=e6113ebebf7b4a1a9829f6a6a5263233)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:57.005346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:57.006952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 228/453] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:33:56 2022] GET /identity/v3/projects/e6113ebebf7b4a1a9829f6a6a5263233 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:57.013381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:57.107225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02a88-beb6-43d9-be14-d1fb9378e9cf None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.132007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:57.140048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256854c0-98f7-4a05-b0fa-4d787ef3ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.146831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256854c0-98f7-4a05-b0fa-4d787ef3ab5d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.146831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256854c0-98f7-4a05-b0fa-4d787ef3ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.146831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256854c0-98f7-4a05-b0fa-4d787ef3ab5d None admin] PATH_INFO: `/v3/groups/8d7414808fb5424489f7f450aeefb4b6` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.146831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256854c0-98f7-4a05-b0fa-4d787ef3ab5d None admin] RBAC: Authorizing `identity:get_group(group_id=8d7414808fb5424489f7f450aeefb4b6)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:57.146831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256854c0-98f7-4a05-b0fa-4d787ef3ab5d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:57.146831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 226/454] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Aug 18 20:33:57 2022] GET /identity/v3/groups/8d7414808fb5424489f7f450aeefb4b6 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:57.151224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:33:57.247096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cf4e9-9848-4de7-a4f6-8bbb35b44eb1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:33:57.279769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103e5a1-2301-4f92-bb0e-df264e550721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:33:57.280351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103e5a1-2301-4f92-bb0e-df264e550721 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:57.280625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103e5a1-2301-4f92-bb0e-df264e550721 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:57.280889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103e5a1-2301-4f92-bb0e-df264e550721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:57.281609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103e5a1-2301-4f92-bb0e-df264e550721 None admin] RBAC: Adding query filter params (group.id=8d7414808fb5424489f7f450aeefb4b6, role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=e6113ebebf7b4a1a9829f6a6a5263233) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:33:57.281912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103e5a1-2301-4f92-bb0e-df264e550721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:33:57.283317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103e5a1-2301-4f92-bb0e-df264e550721 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:33:57.288818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 229/455] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Aug 18 20:33:57 2022] GET /identity/v3/role_assignments?group.id=8d7414808fb5424489f7f450aeefb4b6&scope.project.id=e6113ebebf7b4a1a9829f6a6a5263233&role.id=5eebc7f04cfc4979a378bf94830482af => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:33:59.609809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427099e7-9742-4dea-88b7-3e6e8de4ecf5 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.610787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427099e7-9742-4dea-88b7-3e6e8de4ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.611265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427099e7-9742-4dea-88b7-3e6e8de4ecf5 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.613114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 227/456] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:59.618863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbb64-d84f-4014-b093-ebadb9444fd7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.620026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbb64-d84f-4014-b093-ebadb9444fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.621035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbb64-d84f-4014-b093-ebadb9444fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.641232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2f1bbb64-d84f-4014-b093-ebadb9444fd7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:59.642750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2f1bbb64-d84f-4014-b093-ebadb9444fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:59.653516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:33:59.727469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 230/457] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:33:59.878873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556514d-47d3-43d1-a060-387f46f47ca9 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.879489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556514d-47d3-43d1-a060-387f46f47ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.879958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556514d-47d3-43d1-a060-387f46f47ca9 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.881826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 228/458] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:59.900649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c065a8-4c8a-4be0-8e80-06e4baee0450 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.901323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c065a8-4c8a-4be0-8e80-06e4baee0450 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.901826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c065a8-4c8a-4be0-8e80-06e4baee0450 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.903744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 231/459] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:33:59.904605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceca895-1358-4043-8127-ba6fb457d8d3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.904895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceca895-1358-4043-8127-ba6fb457d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.905167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceca895-1358-4043-8127-ba6fb457d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.913440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c701c-b8e4-45fd-abb9-1aca35be2f72 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:33:59.914032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c701c-b8e4-45fd-abb9-1aca35be2f72 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:33:59.914506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c701c-b8e4-45fd-abb9-1aca35be2f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:33:59.937812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-dceca895-1358-4043-8127-ba6fb457d8d3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:59.939301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dceca895-1358-4043-8127-ba6fb457d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:33:59.946518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5e1c701c-b8e4-45fd-abb9-1aca35be2f72 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:33:59.949278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5e1c701c-b8e4-45fd-abb9-1aca35be2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:00.058760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 232/460] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:00.061044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c701c-b8e4-45fd-abb9-1aca35be2f72 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:00.074628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 229/461] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:00.175138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:00.216949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c701c-b8e4-45fd-abb9-1aca35be2f72 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:00.261894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:00.263173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.263673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.264142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.278461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:00.280170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:00.297907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:00.298850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:00.299734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:00.299734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:00.299734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:00.301494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 233/462] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:00.307458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceca895-1358-4043-8127-ba6fb457d8d3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:00.377114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:00.445072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceca895-1358-4043-8127-ba6fb457d8d3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:00.485810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:00.498624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd1fee-97b6-4903-ba42-15980454621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:00.499575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd1fee-97b6-4903-ba42-15980454621d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.500013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd1fee-97b6-4903-ba42-15980454621d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.500443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd1fee-97b6-4903-ba42-15980454621d None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.501246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd1fee-97b6-4903-ba42-15980454621d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:00.501857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd1fee-97b6-4903-ba42-15980454621d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:00.503453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd1fee-97b6-4903-ba42-15980454621d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:00.522800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 230/463] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:00.524600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940fbf-806b-4a9e-8969-dfd758c9fcda None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.525086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940fbf-806b-4a9e-8969-dfd758c9fcda None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.525577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940fbf-806b-4a9e-8969-dfd758c9fcda None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.527606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 231/464] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:00.534123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954457a-e81e-4f4f-b7eb-b391ac267e72 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.534402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954457a-e81e-4f4f-b7eb-b391ac267e72 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.534678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954457a-e81e-4f4f-b7eb-b391ac267e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.555142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1954457a-e81e-4f4f-b7eb-b391ac267e72 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:00.557693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1954457a-e81e-4f4f-b7eb-b391ac267e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:00.563286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1b47-575a-4de6-8116-6e65c7775d3f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:00.590160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:00.600087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:00.605148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.605148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.605148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.612652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:00.614127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:00.635422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 232/465] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:00.635942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:00.637019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:00.638126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:00.638126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:00.638126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:00.638286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954457a-e81e-4f4f-b7eb-b391ac267e72 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:00.638360 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 234/466] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:00.638360 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:00.745926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954457a-e81e-4f4f-b7eb-b391ac267e72 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:00.764416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0d15-65ae-414a-864a-a958e209ba1d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:00.772948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:00.798109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:00.798734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.799027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.799302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.799981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:00.800833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:00.801459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:00.801565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.801733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.802005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.814449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:00.816200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:00.831716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:00.837614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:00.838446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:00.838446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:00.838446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:00.838446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 235/467] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:00.838446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:00.869663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:00.938790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253babeb-4a6c-4408-af2f-aaec9886537e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:00.959390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 233/468] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:00 2022] POST /identity/v3/users => generated 246 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:00.959390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:00.991510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:00.992134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:00.992415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:00.992985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:00.993775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:00.994496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:00.996307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.015610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 236/469] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:01.017195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.084038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe377-0191-4a58-bd0b-8b6ff4a068bf None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.132372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.133059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.133328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.133596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.134253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:01.134565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.137128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.144318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.151193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 234/470] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:01.155229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43874d97-7b80-4350-852f-f8aa0f20c1f6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.156381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.198013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.210899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.211586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.211875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.212154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.223757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.225262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:01.244474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:01.245973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:01.246862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:01.246862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:01.246862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:01.246862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 237/471] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:01.247103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.304383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c031d-4383-4879-8247-8a4ef95be700 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.341155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.341760 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.342034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.352202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.352911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.354395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.387618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489570c7-7315-471e-b3a2-f8b349d93ac9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.423100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11c359-fcde-4497-9a3e-1c542d3c4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.424004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11c359-fcde-4497-9a3e-1c542d3c4f81 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.424444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11c359-fcde-4497-9a3e-1c542d3c4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.424721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11c359-fcde-4497-9a3e-1c542d3c4f81 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.425371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11c359-fcde-4497-9a3e-1c542d3c4f81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.426835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11c359-fcde-4497-9a3e-1c542d3c4f81 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.428900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 235/472] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:01 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:01.435427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.507846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.515006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 238/473] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:01 2022] POST /identity/v3/users => generated 248 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:01.517928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4423d1-2879-4d04-853c-e428b16349d8 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.518558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4423d1-2879-4d04-853c-e428b16349d8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.519045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4423d1-2879-4d04-853c-e428b16349d8 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.522623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 239/474] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:01.529703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688500a9-75ab-4f24-8053-f37f67d0c5cf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.531522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688500a9-75ab-4f24-8053-f37f67d0c5cf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.531836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688500a9-75ab-4f24-8053-f37f67d0c5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.563090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:01.579652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-688500a9-75ab-4f24-8053-f37f67d0c5cf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:01.580991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-688500a9-75ab-4f24-8053-f37f67d0c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:01.597848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c51921-1e59-4d23-b557-ab9c0c5a5112 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.659692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.661233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.661719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.662207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.663758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:01.664289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.667243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.687103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 236/475] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:01.694598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:01.710156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 240/476] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:01.841422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6e36-5cdd-4cae-a1ad-e82b1e4978c2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:01.881785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:01.882748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:01.883253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:01.883762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:01.884620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:01.886902 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:01.981753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 237/477] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:01 2022] POST /identity/v3/users => generated 249 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:34:02.002289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688500a9-75ab-4f24-8053-f37f67d0c5cf None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.118270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688500a9-75ab-4f24-8053-f37f67d0c5cf None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.149496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:02.159034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.159696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.159977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.161938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.161938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.162490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.222359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.sql.core [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:34:02.222359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 20:34:02.222359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [parameters: {'id': '6186ff013cdd41bbb035c53ef2d59cbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 20:34:02.222359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88549) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:02.238473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:02.239575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application yield resource Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise self.value Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application session.commit() Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:34:02.240466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:34:02.241335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:02.242230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:02.243049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [parameters: {'id': '6186ff013cdd41bbb035c53ef2d59cbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:02.245660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 20:34:02.247848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:02.249924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 241/478] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Aug 18 20:34:02 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:02.250074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.250512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:02.374692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114bf4-62b4-4711-b6ad-0b0022d6240f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.414167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a2aa-2295-4851-b243-72acce4b4a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.415147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a2aa-2295-4851-b243-72acce4b4a1c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.415715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a2aa-2295-4851-b243-72acce4b4a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.416197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a2aa-2295-4851-b243-72acce4b4a1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.427130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a2aa-2295-4851-b243-72acce4b4a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-4b50a2aa-2295-4851-b243-72acce4b4a1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:02.432943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:02.433829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:34:02.434624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:02.437226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 238/479] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:02.442457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:02.558515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae3218-a9fb-4aae-beb4-0c5054de7f9e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:02.595727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8c9f1-da1e-4252-b15f-b162555a95c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:02.596734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8c9f1-da1e-4252-b15f-b162555a95c3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:02.597264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8c9f1-da1e-4252-b15f-b162555a95c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:02.597745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8c9f1-da1e-4252-b15f-b162555a95c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:02.598625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8c9f1-da1e-4252-b15f-b162555a95c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:02.599136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8c9f1-da1e-4252-b15f-b162555a95c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:02.600732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8c9f1-da1e-4252-b15f-b162555a95c3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:02.610986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 242/480] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:03.189746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30c471-227b-40e6-8a5e-af18ca9ba356 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.191130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30c471-227b-40e6-8a5e-af18ca9ba356 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.191837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30c471-227b-40e6-8a5e-af18ca9ba356 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.194445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 239/481] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:03.201237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f9d9-d42c-449f-9a89-2bd647c550ee None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.201850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f9d9-d42c-449f-9a89-2bd647c550ee None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.201850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f9d9-d42c-449f-9a89-2bd647c550ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.226451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3c54f9d9-d42c-449f-9a89-2bd647c550ee None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:03.227708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3c54f9d9-d42c-449f-9a89-2bd647c550ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:03.298496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:03.318642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 243/482] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:03.679215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30c471-227b-40e6-8a5e-af18ca9ba356 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:03.761485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:03.765962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c263-461c-4a6e-b4c6-80b97a168ce3 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.766258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c263-461c-4a6e-b4c6-80b97a168ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.766536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c263-461c-4a6e-b4c6-80b97a168ce3 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.768619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 244/483] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:03.773263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e019a7-4b01-4014-b881-69a58b31e9d8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.773549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e019a7-4b01-4014-b881-69a58b31e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.773827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e019a7-4b01-4014-b881-69a58b31e9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.809410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d7e019a7-4b01-4014-b881-69a58b31e9d8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:03.812114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d7e019a7-4b01-4014-b881-69a58b31e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:03.832499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30c471-227b-40e6-8a5e-af18ca9ba356 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:03.892671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d4811-edd0-4a35-93c8-cd1395370b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:03.893254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4811-edd0-4a35-93c8-cd1395370b6f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:03.893544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4811-edd0-4a35-93c8-cd1395370b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:03.893824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4811-edd0-4a35-93c8-cd1395370b6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:03.921510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d4811-edd0-4a35-93c8-cd1395370b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:03.928422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 245/484] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d16d4811-edd0-4a35-93c8-cd1395370b6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:03.929892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:03.930789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:03.931615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:03.934245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 240/485] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:03.939616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e019a7-4b01-4014-b881-69a58b31e9d8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.045365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e019a7-4b01-4014-b881-69a58b31e9d8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.060373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.062778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c740d7-c6b8-4796-9075-f6a00ba1be74 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.063066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c740d7-c6b8-4796-9075-f6a00ba1be74 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.063343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c740d7-c6b8-4796-9075-f6a00ba1be74 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.065460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 241/486] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:04.071394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280dd7-4059-4903-a30d-0a19d46c8c30 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.071698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280dd7-4059-4903-a30d-0a19d46c8c30 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.075927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280dd7-4059-4903-a30d-0a19d46c8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.094180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.094551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0f280dd7-4059-4903-a30d-0a19d46c8c30 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:04.094794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.095080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.095916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0f280dd7-4059-4903-a30d-0a19d46c8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:04.097613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.098596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:04.099812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.101251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.110275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 246/487] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:04.121220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.246967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 242/488] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:04.287327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526333f-7c8f-4f4b-8f7b-8d62ac3b424e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.321944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.322586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.322875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.323751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.334785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.336410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:04.351266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:04.352218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:04.353538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:04.353538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:04.353538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:04.353538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 247/489] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:04.360490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280dd7-4059-4903-a30d-0a19d46c8c30 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.378717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.447719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.453379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.508357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280dd7-4059-4903-a30d-0a19d46c8c30 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.548986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.550129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.550412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.550686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.551336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:04.551664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.553053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.565620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 243/490] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:04.566454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.602440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bdfa-8ea2-40aa-bfd0-e0e811a4ee3a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.641776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.642408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.642689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.642962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.653615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:04.658310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:04.659186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 248/491] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:04.665351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.676887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624166a7-800e-4d60-a09d-ce2c6caa0f95 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.691436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.712437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b26813-9ac3-480b-b6b3-13032f50c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.713084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26813-9ac3-480b-b6b3-13032f50c465 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.713368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26813-9ac3-480b-b6b3-13032f50c465 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.713646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26813-9ac3-480b-b6b3-13032f50c465 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.724341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b26813-9ac3-480b-b6b3-13032f50c465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-08b26813-9ac3-480b-b6b3-13032f50c465 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:04.729089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:04.730665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:04.731596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 244/492] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:04.736653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4eff4-8d90-4e70-b436-d84b2cf35fd7 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.736941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4eff4-8d90-4e70-b436-d84b2cf35fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.737223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4eff4-8d90-4e70-b436-d84b2cf35fd7 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.738611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 245/493] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:04.743463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4eff4-8d90-4e70-b436-d84b2cf35fd7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.763865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.775897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fb74-27de-4f7a-a57c-bc1b8f85df9c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.812694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.813331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.813621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.813895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.821641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.823666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:04.836834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:04.837774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:04.838726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 249/494] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:04.839871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:04.859620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4eff4-8d90-4e70-b436-d84b2cf35fd7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.897685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f6b1e-a43a-44eb-b964-f80efbf30e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.898302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6b1e-a43a-44eb-b964-f80efbf30e11 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.898739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6b1e-a43a-44eb-b964-f80efbf30e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.899017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6b1e-a43a-44eb-b964-f80efbf30e11 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.899742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f6b1e-a43a-44eb-b964-f80efbf30e11 None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:04.900051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f6b1e-a43a-44eb-b964-f80efbf30e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.901991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f6b1e-a43a-44eb-b964-f80efbf30e11 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:04.910246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 246/495] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:04.911439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df102ae8-d50c-4425-86f3-3c0658cc1612 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.911726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df102ae8-d50c-4425-86f3-3c0658cc1612 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.912002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df102ae8-d50c-4425-86f3-3c0658cc1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.930401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-df102ae8-d50c-4425-86f3-3c0658cc1612 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:04.931630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-df102ae8-d50c-4425-86f3-3c0658cc1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:04.955249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e42cb-f441-400b-b8fa-1b7dc2ac26ed None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:04.961850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:04.992522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:04.993146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:04.993434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:04.993713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:04.994385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:04.994698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:04.996197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.001836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 247/496] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:05.002684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df102ae8-d50c-4425-86f3-3c0658cc1612 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.015679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 250/497] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:05.016976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.034559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.110769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df102ae8-d50c-4425-86f3-3c0658cc1612 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.150723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b1678-1711-44f0-847b-bfc1d6d4531d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.152000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.152769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.153552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.153998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.155782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:05.156243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.157923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.188515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.189303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.189699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.190079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.202565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.204196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.210417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 248/498] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:05.211456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:05.225284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:05.226495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:05.227558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:05.227558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:05.227558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:05.228741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 251/499] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:05.229741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.245056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.300671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.331673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abaff-8c2d-4ce4-98af-4a56345606a4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.344960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7e33-f4e1-4d5c-abae-c993e8678236 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.369809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.370462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.370742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.371042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.378410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b1f6-b896-4c9d-ab7c-93709bf39cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.379008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b1f6-b896-4c9d-ab7c-93709bf39cae None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.379287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b1f6-b896-4c9d-ab7c-93709bf39cae None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.379593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b1f6-b896-4c9d-ab7c-93709bf39cae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.380950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.382417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:05.397598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:05.398711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:05.400035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:05.400035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:05.400035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:05.400035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 249/500] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:05.400035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.450019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b1f6-b896-4c9d-ab7c-93709bf39cae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.451490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b1f6-b896-4c9d-ab7c-93709bf39cae None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.477675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.501223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a5f3-f942-42ae-b05f-621a41df3b87 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.516499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.539125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.540325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.540325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.540325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.540951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:05.541256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.542684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.555738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 250/501] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:05.556487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.563820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 252/502] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:05.565118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280bd3-e4f7-49ac-a2dc-f0b94be6d838 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.565394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280bd3-e4f7-49ac-a2dc-f0b94be6d838 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.565661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280bd3-e4f7-49ac-a2dc-f0b94be6d838 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.569004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 253/503] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:05.569004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280bd3-e4f7-49ac-a2dc-f0b94be6d838 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.664496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faaba1-85a9-411c-9686-2450de99a9cd None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.686797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280bd3-e4f7-49ac-a2dc-f0b94be6d838 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.709015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.709652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.709933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.710208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.714069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.722510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:05.725422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.726025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.726306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.726593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.727238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:05.727384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:05.728395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:05.729243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:05.729845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.729845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.729963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 251/504] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:05.729963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.740783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 254/505] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:05.741614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.767909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:05.839287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc900-3706-44db-8622-b8c0f139ff31 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.846459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b935fb-efd7-4aec-b701-8e415b2908a0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:05.877241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7f3d2-89ee-4281-bf06-6bc7a786e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.877871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7f3d2-89ee-4281-bf06-6bc7a786e953 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.878153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7f3d2-89ee-4281-bf06-6bc7a786e953 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.878426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7f3d2-89ee-4281-bf06-6bc7a786e953 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.881552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:05.882176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.882458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.882735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.886263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7f3d2-89ee-4281-bf06-6bc7a786e953 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.888014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7f3d2-89ee-4281-bf06-6bc7a786e953 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.895435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:05.895435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-e7d7f3d2-89ee-4281-bf06-6bc7a786e953 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:05.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:05.903508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:05.904378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 252/506] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:05.904973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b3fa-7a36-43ee-8af6-273f6a675ea0 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:05.904973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b3fa-7a36-43ee-8af6-273f6a675ea0 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:05.904973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b3fa-7a36-43ee-8af6-273f6a675ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:05.921244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:05.922514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:05.924248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:05.924248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:05.924248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:05.924248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 255/507] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:05.924629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:05.926311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fce5b3fa-7a36-43ee-8af6-273f6a675ea0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:05.927650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fce5b3fa-7a36-43ee-8af6-273f6a675ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:05.990814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.007853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 253/508] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:06.008698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5b3fa-7a36-43ee-8af6-273f6a675ea0 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.029442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.062270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb311202-eba5-4f6c-8c11-2baa0a6f8d37 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.107317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.108272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.108722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.109011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.109829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:06.110267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.111672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.121820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 256/509] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.122641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.128811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5b3fa-7a36-43ee-8af6-273f6a675ea0 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.174262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.175193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.175520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.175793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.184238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.185826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:06.197793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:06.198877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:06.200018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:06.205351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 254/510] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:06.206196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.230939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbc48b-5c68-4323-9935-67d0a0dbac06 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.264878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.274572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.274572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.274572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.274572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.276595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:06.276595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.277233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.291298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.317444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 257/511] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.318978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.326895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625b58-5b4a-4ae9-9029-19dcb7fac013 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.363703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.364670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.364952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.365225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.365868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:06.366172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.367574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.379019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 255/512] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.379830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.426950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23eb9-8d52-4f9a-b074-f3ce1ecfb9f5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.460099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.460724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.461004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.461300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.471855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.473315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.478407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121d3c-77cf-4ea9-9c04-2e47ac7e648d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.486563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:06.488584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:06.489511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:06.490376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:06.490376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:06.490376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:06.490376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 258/513] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:06.490597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.519099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.519738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.520021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.520295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.521027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:06.521336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.522775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.535884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.540284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 256/514] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.541170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.593224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602c7d9-ec5a-480a-a2bc-5ac155345906 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.628964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.629501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.629782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.630057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.642201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.643696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.650406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b28f7-0d8f-4c94-96db-3ae48fdd3f3a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:06.659044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:06.660534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:06.661382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:06.661382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:06.661382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:06.663518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 259/515] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:06.664520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.686821 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.687513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.687791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.688060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.718561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.755009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.756507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.766884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.770695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90cd71-5a2d-4818-9f5d-185e8da88bce None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.804187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.804801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.805074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.805346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.812126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.813569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:06.825683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:06.827539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 260/516] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:06.829348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.854826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 257/517] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:06.855761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.920574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:06.933574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f60529-6433-4a76-9be9-6c9bd5a70a19 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.957753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6077ee-3bc8-424e-bfbc-f07153b0226d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:06.969599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.970222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.970499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.970772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:06.971447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:06.971758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:06.973118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:06.984273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 261/518] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:06.985212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:06.992140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:06.992776 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:06.993071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:06.993327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.005177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.061227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.062692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.086933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312702bb-369e-4736-bec9-98abd8ce28a5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.121261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.121858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.122146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.122417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.123051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:07.123353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.124276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.124733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.136234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 262/519] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:07.137045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.163956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 258/520] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:07.164802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.221037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.241375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf437e9-19b2-48f0-93d4-c7b26622305b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.263483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ddccc-ec7f-4d4b-b6b3-8b5dc15459ee None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.275909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.276519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.276800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.277079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.277769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:07.278074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.279559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.296402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 263/521] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:07.296731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.297201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.297370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.297640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.297916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.308894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.310354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:07.325614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:07.326675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:07.327557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:07.327557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:07.327557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:07.327557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 259/522] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:07.327557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.348869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.400914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2895-095c-4c38-9b63-9e1631a3c644 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.430143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4c0f-311a-45bc-a972-73dc87540307 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.434771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.435426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.435713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.435986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.442801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.444281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.446007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:07.456573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:07.457464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 264/523] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:07.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.468673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.469278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.469564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.469843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.470481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.472028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.552768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 260/524] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:07 2022] POST /identity/v3/users => generated 247 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:07.553653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.566383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffd75d-26ae-4b47-a774-d9bb012eddfe None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.607581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.608230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.608511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.608783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.621526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.624011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:07.643811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:07.644798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:07.650847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:07.650847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:07.650847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:07.650847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 265/525] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:07.650847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.658064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.691703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42bfe9-f9fc-415f-a1d4-c31ba137b33f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.705247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.731440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.732012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.732298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.732573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.733319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=79b9a470bced4efcaef3ed849f6963fd) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:07.733631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.735082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.742638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 261/526] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/role_assignments?user.id=79b9a470bced4efcaef3ed849f6963fd&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:07.743051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.773510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be76ae0-14c8-4af4-93cf-5915bdcf36c7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.816132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.816762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.817048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.817324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.817990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:07.818325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.823406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.833619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 266/527] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:07.834486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.886637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd82d-a136-4a35-9f02-5b59409b8e41 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.943765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:07.943765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:07.943765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:07.943765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:07.944189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:07.944189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:07.944189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:07.948749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:07.955678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7c5f-7f0c-4c05-9ca9-47f316fbea26 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:07.965525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 262/528] 10.222.0.62 () {56 vars in 1139 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:07.966691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:07.972336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.008678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.009660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.010724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.011232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.012138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:08.013365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.015753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.034228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 267/529] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:08.034228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.102794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00261e8-e4c4-418f-ad48-59d8ea8be94e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.140188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.140926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.141207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.141477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.149891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.152175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.156862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9952a-db52-46a2-b073-872c76114ed8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:08.167933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:08.168826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:08.169697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 263/530] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:08.170626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.206551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.207537 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.207964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.208374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.240895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.261545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.306965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d46ae-f347-4095-b24c-417909e404e0 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.312217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.313807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.356589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.358177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.358457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.358727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.367158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.369070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:08.384092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:08.384984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:08.386382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 264/531] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:08.387395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.446682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 268/532] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:08.447626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.498400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a74c7-b377-45b7-b2e7-b16009c176e7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.516525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.522934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.537984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.538714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.539120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.539533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.540413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:08.540814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.542436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.557644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbcfc5-82e1-4013-8967-804548a8f04f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.566691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 265/533] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:08.567783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.595205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.596217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.596703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.598372 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:08.598972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.601190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.615117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 269/534] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:08.616408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.679923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41103c1d-4d07-43c9-b105-740c9774b59c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.722057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.723036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.723415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.724186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.733634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095acc4-ebd9-4842-928b-199486b451b0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.737119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.738793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:08.757280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:08.758226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:08.759156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:08.759156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:08.759156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:08.765486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 266/535] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:08.765486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.778958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.787861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.789114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.789601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.790057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.791051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=b743dbcea55f4ab7b339eb7dc6e30630) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:08.792678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.794299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:08.800466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:08.804339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 270/536] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/role_assignments?user.id=b743dbcea55f4ab7b339eb7dc6e30630&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:08.805610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:08.935086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1989-f596-4f84-9893-106e7207cb45 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.959040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be9e6-450b-43c3-a245-d1b6c36c625f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:08.978263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:08.979913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:08.980402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:08.980855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:08.981713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:08.982199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:08.983962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.003642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 271/537] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.005563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.053244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.053873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.054231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.054582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.055898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=c1f59dfd806f4d1cada6a42f5fce3b27) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:09.056331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.059164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.067161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 267/538] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:08 2022] GET /identity/v3/role_assignments?user.id=c1f59dfd806f4d1cada6a42f5fce3b27&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.075155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:09.128468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48973ec3-a16b-4b06-90c2-f7c6af614a16 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.167058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.168038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.168466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.168900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.176506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.178216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:09.191648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:09.192733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:09.193774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:09.195521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 272/539] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:09.203413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.378460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:09.394296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e6b8-0d3f-4d4f-ba74-ef4d1e7b9843 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.437739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da1f3-7aaa-4864-a73e-11579c03fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.438354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da1f3-7aaa-4864-a73e-11579c03fc87 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.438637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da1f3-7aaa-4864-a73e-11579c03fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.438952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da1f3-7aaa-4864-a73e-11579c03fc87 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.439697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da1f3-7aaa-4864-a73e-11579c03fc87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:09.440004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da1f3-7aaa-4864-a73e-11579c03fc87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.441465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da1f3-7aaa-4864-a73e-11579c03fc87 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.459561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 268/540] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.465567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:09.593769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61776463-f909-4719-a866-c0a3c7024b0d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:09.612544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:09.643837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5e064-1f60-4805-a50c-474df402bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:09.644645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e064-1f60-4805-a50c-474df402bb5b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.645185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e064-1f60-4805-a50c-474df402bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.645501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e064-1f60-4805-a50c-474df402bb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.646251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5e064-1f60-4805-a50c-474df402bb5b None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=162eb7d6a9894e4ca60aa8da4537a1ed) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:09.646563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5e064-1f60-4805-a50c-474df402bb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:09.648035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5e064-1f60-4805-a50c-474df402bb5b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:09.656519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 273/541] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:09 2022] GET /identity/v3/role_assignments?user.id=162eb7d6a9894e4ca60aa8da4537a1ed&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:09.904283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c179eb-4e6a-4bd5-a099-457e536cbfd2 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.904766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c179eb-4e6a-4bd5-a099-457e536cbfd2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.904766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c179eb-4e6a-4bd5-a099-457e536cbfd2 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.906090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 269/542] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:09.911432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffdb13-e1d6-4153-b2e7-3d5c54b89e6b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.911724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffdb13-e1d6-4153-b2e7-3d5c54b89e6b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.911999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffdb13-e1d6-4153-b2e7-3d5c54b89e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.933372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f256-b79f-41f2-afb0-c00cef0180fc None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.933665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f256-b79f-41f2-afb0-c00cef0180fc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.933941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f256-b79f-41f2-afb0-c00cef0180fc None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.935536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 270/543] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:09.935972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c5ffdb13-e1d6-4153-b2e7-3d5c54b89e6b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:09.937190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c5ffdb13-e1d6-4153-b2e7-3d5c54b89e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:09.945925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020bad-bf9c-40ef-83ee-8bbb117da5bb None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:09.946533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020bad-bf9c-40ef-83ee-8bbb117da5bb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:09.947038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020bad-bf9c-40ef-83ee-8bbb117da5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:09.978929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-26020bad-bf9c-40ef-83ee-8bbb117da5bb None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:09.983415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-26020bad-bf9c-40ef-83ee-8bbb117da5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:10.075692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 274/544] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:10.117779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 271/545] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:10.398268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffdb13-e1d6-4153-b2e7-3d5c54b89e6b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.458255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26020bad-bf9c-40ef-83ee-8bbb117da5bb None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.546981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffdb13-e1d6-4153-b2e7-3d5c54b89e6b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.568425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:10.614454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:10.621184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.622061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.623536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.623960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.647765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:10.650780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26020bad-bf9c-40ef-83ee-8bbb117da5bb None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:10.664175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:10.665289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:10.666417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:10.668764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 275/546] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:10.674354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.717340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.717974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.718252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.718526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.729707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:10.734529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:10.735420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:10.736622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 272/547] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:10.743765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.849255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a986-e177-4e80-8203-84cf0d7ac044 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:10.920125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:10.920871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:10.921110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:10.921263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:10.921853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:10.922160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:10.923579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:10.942168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 276/548] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:10.947573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:10.950508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32ff0e-65ed-4c76-8512-970e9fc5316b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.010154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.045058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0556dea-8bcb-42b9-ab8d-5b604638473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.045940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556dea-8bcb-42b9-ab8d-5b604638473c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.046222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556dea-8bcb-42b9-ab8d-5b604638473c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.046503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556dea-8bcb-42b9-ab8d-5b604638473c None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.047187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556dea-8bcb-42b9-ab8d-5b604638473c None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:11.047521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556dea-8bcb-42b9-ab8d-5b604638473c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.048904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556dea-8bcb-42b9-ab8d-5b604638473c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.067016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 273/549] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:11.069287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25578fe-987f-4f0f-bd7a-96d624ed5116 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.072746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72614efe-c58e-4dfb-b5f0-256ff8948177 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.073547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72614efe-c58e-4dfb-b5f0-256ff8948177 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.073831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72614efe-c58e-4dfb-b5f0-256ff8948177 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.078993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 274/550] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:11.079820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72614efe-c58e-4dfb-b5f0-256ff8948177 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.082772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.114923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138a229-76f9-478b-87b5-f60d39a2cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.115623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138a229-76f9-478b-87b5-f60d39a2cacb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.115912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138a229-76f9-478b-87b5-f60d39a2cacb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.116185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138a229-76f9-478b-87b5-f60d39a2cacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.128977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138a229-76f9-478b-87b5-f60d39a2cacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.130600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138a229-76f9-478b-87b5-f60d39a2cacb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2138a229-76f9-478b-87b5-f60d39a2cacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:11.146564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:11.147552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:11.148409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:11.148409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:11.148409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:11.152434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 277/551] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:11.153772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3082c6-f14d-4b4c-8c56-9aa6144306de None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.154148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3082c6-f14d-4b4c-8c56-9aa6144306de None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.154323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3082c6-f14d-4b4c-8c56-9aa6144306de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.172674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ec3082c6-f14d-4b4c-8c56-9aa6144306de None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:11.173777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ec3082c6-f14d-4b4c-8c56-9aa6144306de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:11.195750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72614efe-c58e-4dfb-b5f0-256ff8948177 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.236369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.237326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.237903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.238364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.249215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 278/552] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:11.250397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3082c6-f14d-4b4c-8c56-9aa6144306de None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.250605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.252320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.267381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:11.268301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:11.269192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:11.270059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:11.270059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:11.270059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:11.272098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 275/553] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:11.277849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.381423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.425361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3082c6-f14d-4b4c-8c56-9aa6144306de None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.454001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468f25e-8713-419f-84b7-f66ccee1244d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.465376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7ede6-29a3-4e4f-903d-a714f42caf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.466060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7ede6-29a3-4e4f-903d-a714f42caf84 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.466361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7ede6-29a3-4e4f-903d-a714f42caf84 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.466639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7ede6-29a3-4e4f-903d-a714f42caf84 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.467293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7ede6-29a3-4e4f-903d-a714f42caf84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:11.467633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7ede6-29a3-4e4f-903d-a714f42caf84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.469023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7ede6-29a3-4e4f-903d-a714f42caf84 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.481533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 279/554] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:11.482787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e80c7d-5232-4571-bc27-45cf05b4e9bd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.483075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e80c7d-5232-4571-bc27-45cf05b4e9bd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.483370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e80c7d-5232-4571-bc27-45cf05b4e9bd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.484599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 280/555] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:11.489403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e80c7d-5232-4571-bc27-45cf05b4e9bd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.495902 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89becdea-0b2f-49e4-b477-ec987a0f304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.496584 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89becdea-0b2f-49e4-b477-ec987a0f304b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.496915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89becdea-0b2f-49e4-b477-ec987a0f304b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.497200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89becdea-0b2f-49e4-b477-ec987a0f304b None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.497855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89becdea-0b2f-49e4-b477-ec987a0f304b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:11.498164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89becdea-0b2f-49e4-b477-ec987a0f304b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.499655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89becdea-0b2f-49e4-b477-ec987a0f304b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.512964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 276/556] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:11.514384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53163-439a-4ac6-92c6-aa68ff2a76cb None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.514770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53163-439a-4ac6-92c6-aa68ff2a76cb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.515281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53163-439a-4ac6-92c6-aa68ff2a76cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.534351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a8d53163-439a-4ac6-92c6-aa68ff2a76cb None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:11.535783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a8d53163-439a-4ac6-92c6-aa68ff2a76cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:11.566693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.599639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e80c7d-5232-4571-bc27-45cf05b4e9bd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.610867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 277/557] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:11.611807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53163-439a-4ac6-92c6-aa68ff2a76cb None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.637292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.638531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.639061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.639673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.647881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.649568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.660459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:11.664227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:11.665100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:11.666069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:11.669206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 281/558] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:11.670224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.823691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53163-439a-4ac6-92c6-aa68ff2a76cb None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.859758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.860384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.860663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.860931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.868690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:11.870280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:11.882974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:11.889697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 278/559] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:11.890665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.903601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db8774-bbe5-46ca-b16b-beb6e698dbdc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.933774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:11.938530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:11.939152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:11.939452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:11.939721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:11.950478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:11.955173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:11.956199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 282/560] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:11.957678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:11.989401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5d6a3-557e-479c-b2b9-c25b476a3896 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:11.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.022736 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.023340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.023654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.023925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.024652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:12.024954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.027025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.049586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 279/561] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:12.049586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.060658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4137e-026f-4aac-8a3c-376327477fbe None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.097554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc48e-664c-4da6-9446-93a23ea98014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.098142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc48e-664c-4da6-9446-93a23ea98014 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.098420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc48e-664c-4da6-9446-93a23ea98014 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.098690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc48e-664c-4da6-9446-93a23ea98014 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.099474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cc48e-664c-4da6-9446-93a23ea98014 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:12.099782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cc48e-664c-4da6-9446-93a23ea98014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.101265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cc48e-664c-4da6-9446-93a23ea98014 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.118883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 283/562] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:12.120217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ff47-58e0-4d0e-a44f-e1839b44c2dd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.120502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ff47-58e0-4d0e-a44f-e1839b44c2dd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.120777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ff47-58e0-4d0e-a44f-e1839b44c2dd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.122127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 284/563] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:12.122731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612ff47-58e0-4d0e-a44f-e1839b44c2dd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.158373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e8374-df51-4fe5-84bb-bf03a257d9ff None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.174315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.195396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.196019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.196298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.196566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.207169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:12.211922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:12.213047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:12.214471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 280/564] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:12.215162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.230713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612ff47-58e0-4d0e-a44f-e1839b44c2dd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.237878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.264300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.264901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.265179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.265459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.266141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:12.266443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.267902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.275674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 285/565] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:12.277029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.326943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305c2b7-0632-4ceb-8464-93bb48469a20 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.363937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47ef3-03aa-484f-b064-eb71dc7c009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.364570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47ef3-03aa-484f-b064-eb71dc7c009f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.364849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47ef3-03aa-484f-b064-eb71dc7c009f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.365122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47ef3-03aa-484f-b064-eb71dc7c009f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.375090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47ef3-03aa-484f-b064-eb71dc7c009f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.376593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47ef3-03aa-484f-b064-eb71dc7c009f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.382020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a3c34-cf1a-4f02-a14b-b3cab4a624fd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-4cc47ef3-03aa-484f-b064-eb71dc7c009f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:12.391521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:12.392529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:12.393393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:12.393393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.393393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:12.393393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 281/566] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:12.393976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292766c-b98c-4792-b7c8-2b6646185d40 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.394129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292766c-b98c-4792-b7c8-2b6646185d40 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.394404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292766c-b98c-4792-b7c8-2b6646185d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.396741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.412538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6292766c-b98c-4792-b7c8-2b6646185d40 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:12.413822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6292766c-b98c-4792-b7c8-2b6646185d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:12.417725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.418325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.418601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.418867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.480072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 282/567] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:12.480820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292766c-b98c-4792-b7c8-2b6646185d40 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.483814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.496665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.498548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.586996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292766c-b98c-4792-b7c8-2b6646185d40 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.610968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 286/568] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:12.610968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.623790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.624525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.624818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.625069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.625742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:12.626044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.626702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.627439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.641196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 283/569] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:12.641971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.712510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.714888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd545-2c6d-4f79-8851-709783aebe8f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.750008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4623e11-0a40-4c4f-9268-5681376b6a56 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.752247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.752884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.753166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.753438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.763958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.765411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:12.779630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:12.780581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:12.781489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:12.781489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.781489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:12.781489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 287/570] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:12.781489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.787343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.787978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.788261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.788534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.789306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:12.789624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.790980 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.803326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 284/571] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:12.804145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.850029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.889132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6772ef3-252c-4ad1-8736-fae66f4e75e8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.903811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85722-4b0f-4a2f-9dfe-be2507c41f09 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:12.922608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.923237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.923548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.923823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.929586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:12.934703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.936263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.943949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:12.943949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:12.943949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:12.943949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:12.949639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:12.950414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:12.951498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:12.952697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:12.952697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.952697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:12.952903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:12.952984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 288/572] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:12.952984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:12.968442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:12.969609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:12.970708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:12.970708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:12.970708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:12.970708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 285/573] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:12.970708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.055118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39a22f-65a7-4775-a7ca-87f354d258cb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.072005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.074119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79224f7f-080d-4370-b836-f207fdd620b2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.089738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.090370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.090649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.090921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.101199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:13.106836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:13.107985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:13.108832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 289/574] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:13.109529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.111788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.112396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.112672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.112940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.113581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:13.113883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.115244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.131305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 286/575] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:13.131305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.166314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.216899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df39ca-069a-4ec6-af07-e95ff0f8aac1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.225122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfbb71-a32d-467d-92b8-5af9fc6aa46f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.249694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.250380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.250661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.250938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.257499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.258535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.258967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.259132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.259452 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.259739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.260431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:13.260738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.262090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:13.270541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:13.271602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:13.272493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 290/576] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:13.272993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.273455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 287/577] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:13.274027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.311622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.372580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.376450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2c390-3c1e-49cd-9aac-9d56d4f8c68f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.382399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb276c-1719-45cc-97ee-517bb474de8a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.415017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.415653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.415934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.416203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.417494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:13.417738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.418864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.419130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.419502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.419785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.420063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.420705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:13.421010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.422360 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.427666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 288/578] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:13.428465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.434292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 291/579] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:13.435079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.529618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.530387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8725c1-5f1d-4f10-9961-ce51bffdfca1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.535038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a35b2e-dc88-4361-9e31-07cbbbcfc928 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.563917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.564533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.564807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.565076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.568109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.568701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.568977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.569243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.569922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:13.570222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.571666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.573691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.575128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.583302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 292/580] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:13.584109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:13.585878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:13.586841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 289/581] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:13.587913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.611044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.686094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d2b7-afb1-4d57-b81a-999eaf60bcd3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.686598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004023-7cb5-4e42-9e3f-ddd0a6e0d1f6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.719885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.720521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.720839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.721075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.724825 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.725451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.725727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.725997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.727717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.729240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.737612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.739670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:13.743158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:13.744043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:13.745267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 293/582] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:13.745915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:13.757591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:13.758637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:13.759585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:13.759585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:13.759585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:13.759585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 290/583] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:13.759858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.768751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.830839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:13.849483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58166b-06f9-4cdb-b79b-7a9711349211 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.861471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df4a5d-be4c-4ffb-a3af-65463f85eca2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:13.883036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.883716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.883997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.884264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.891964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.893422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.895709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:13.896361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:13.896639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:13.896916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/79b9a470bced4efcaef3ed849f6963fd/roles/79be860b24f44c24aa3d43cf616ffad8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:13.904907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:13.905907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 294/584] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:13.906908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.915625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=79b9a470bced4efcaef3ed849f6963fd, role_id=79be860b24f44c24aa3d43cf616ffad8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:13.917145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:13.981296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 291/585] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:13 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/79b9a470bced4efcaef3ed849f6963fd/roles/79be860b24f44c24aa3d43cf616ffad8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:13.982041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:13.982540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.020600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f874297-080f-461d-a2a2-f06bfc2b6971 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.058193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.058825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.059113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.059408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.060175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:14.060489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.061987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.081431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 295/586] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.082138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.109775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3246cad-6a6e-42dd-8513-ee0cf7dc3314 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.141225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.154770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.155561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.155741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.156104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.156979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:14.157291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.158914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.171965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 292/587] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.172819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.195019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aeb9a-4122-469a-b756-6d56b60c865f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.232301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.232839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.233120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.233395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.234044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:14.234349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.235803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.237238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.247972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 296/588] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.252193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.283556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998493a8-9402-4ff7-990e-fe556b723763 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.316813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.317420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.317758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.318039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.318775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:14.319084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.320587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.351799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 293/589] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.352829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.377816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae6270-6a9d-450a-8fd6-e6fb000b93e3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.403826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.414780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.415552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.415905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.416328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.428142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.429603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:14.444454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:14.445627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:14.451907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:14.451907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:14.451907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:14.451907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 297/590] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:14.451907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.478264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784847-7ae1-4bf0-9443-61d8d88ed8db None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.495820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.516358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.517135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.517488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.517834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.518640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=bc7bfd9c93404d8ea4260832d1b0e284) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:14.519028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.520495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.535749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 294/591] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/role_assignments?user.id=bc7bfd9c93404d8ea4260832d1b0e284&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.536672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.562035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4855dc-2b4e-435c-9c30-8bbafa900e34 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.614767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.616263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.616661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.617043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.629412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.631053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:14.649540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:14.650781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:14.651899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:14.655521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 298/592] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:14.656734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.671102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b8305-3af2-424c-89b2-79399c8479e6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.675424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.709615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.710252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.710537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.710812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.722681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.724682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:14.740003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:14.741025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:14.741929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:14.741929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:14.741929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:14.741929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 295/593] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:14.742593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.778241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544501a-e353-472f-9eac-38c6748c94e5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.785926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.816711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.817591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.818266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.818550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.819508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:14.819821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.821285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.842640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 299/594] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.843694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.867770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa46fe-8dee-460b-9e6d-a8a54e5373f5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:14.912939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:14.913899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:14.914254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:14.914793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:14.915862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:14.916202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:14.917702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:14.941193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 296/595] 10.222.0.62 () {56 vars in 1139 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:14.942352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:14.963017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:14.979916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1d9a1-6c7e-40d0-9162-25d6b30ebd08 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.023541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.024156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.024439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.024712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.025409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:15.025762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.027184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.039954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 300/596] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:15.041154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.080501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.083818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54048c16-b2b9-480a-a764-03e0a730575a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.130810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.132661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.133100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.133568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.143746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.145892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:15.160422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:15.161558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:15.162664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:15.164213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6c6e8-5073-4775-abb2-3762f350dae8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.164497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 297/597] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:15.165366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.212716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.213644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.214342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.214771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.230195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.231693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:15.247441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:15.248496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:15.249394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:15.249394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:15.249394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:15.249394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 301/598] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:15.250156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.254184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.288262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df38da4-0b56-4aa8-aaae-87b3c8484176 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.333195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.343214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.344144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.344530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.344907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.355142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.356685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.357662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90bec-53ce-4ce9-8e4c-7bc36ccaabfa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:15.369354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:15.370276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:15.371152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 298/599] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:15.372312 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.396715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.397676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.398145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.398754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.399702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:15.400191 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.402462 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.415650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 302/600] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:15.417429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.483651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b45b5-8556-4b95-809a-a852b1877054 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.521354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.521855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856777-7b39-431c-ab87-4fa2bcbc18c3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.522112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.522510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.522858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.523613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:15.524010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.526487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.527793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.539698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 299/601] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:15.540601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.560890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.561889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.562363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.562815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.563900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:15.564458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.566072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.573717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.578943 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 303/602] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:15.580076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.655626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7e7d6-ba63-4340-8576-ea710c62ef49 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.693587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.694938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.695523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.696005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/b743dbcea55f4ab7b339eb7dc6e30630/roles/79be860b24f44c24aa3d43cf616ffad8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.702089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51ade9-f072-418b-88b6-0d2b11168e34 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.714511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=b743dbcea55f4ab7b339eb7dc6e30630, role_id=79be860b24f44c24aa3d43cf616ffad8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.719487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.740935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.741564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.742493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.742493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.749262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.750709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:15.762923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:15.772998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 304/603] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:15.773926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.793307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 300/604] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:15 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/b743dbcea55f4ab7b339eb7dc6e30630/roles/79be860b24f44c24aa3d43cf616ffad8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:15.794193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:15.847458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.855402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:15.911834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacaea0-2709-41e3-adbe-e27e1d4a1146 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.953933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407110-bd7b-4452-ad25-6accb75c0ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:15.954999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407110-bd7b-4452-ad25-6accb75c0ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:15.955511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407110-bd7b-4452-ad25-6accb75c0ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:15.955983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407110-bd7b-4452-ad25-6accb75c0ee6 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/c1f59dfd806f4d1cada6a42f5fce3b27/roles/79be860b24f44c24aa3d43cf616ffad8` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:15.973046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99261e-e43f-43d9-abd2-0588ef836ff9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:15.976063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1407110-bd7b-4452-ad25-6accb75c0ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=c1f59dfd806f4d1cada6a42f5fce3b27, role_id=79be860b24f44c24aa3d43cf616ffad8)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:15.978302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1407110-bd7b-4452-ad25-6accb75c0ee6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.011830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e857f4-b774-4c29-8a8a-d08962149424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.012437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e857f4-b774-4c29-8a8a-d08962149424 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.013999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e857f4-b774-4c29-8a8a-d08962149424 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.013999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e857f4-b774-4c29-8a8a-d08962149424 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.013999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e857f4-b774-4c29-8a8a-d08962149424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:16.014359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e857f4-b774-4c29-8a8a-d08962149424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.015835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e857f4-b774-4c29-8a8a-d08962149424 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.031530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 301/605] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:16.031530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0d5dd-db7e-466f-8630-b38ed943a5f0 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.031530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0d5dd-db7e-466f-8630-b38ed943a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.031530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0d5dd-db7e-466f-8630-b38ed943a5f0 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.033300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 302/606] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:16.036532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0d5dd-db7e-466f-8630-b38ed943a5f0 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.080306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 305/607] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:15 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/c1f59dfd806f4d1cada6a42f5fce3b27/roles/79be860b24f44c24aa3d43cf616ffad8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:16.082522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347314-1966-4118-b4b1-0d143e24eee5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.083021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347314-1966-4118-b4b1-0d143e24eee5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.083916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347314-1966-4118-b4b1-0d143e24eee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.110243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ee347314-1966-4118-b4b1-0d143e24eee5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:16.112039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ee347314-1966-4118-b4b1-0d143e24eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:16.200502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 306/608] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:16.221009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0d5dd-db7e-466f-8630-b38ed943a5f0 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.227591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.282128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d76c7f-0978-4504-a1be-f01571156ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.282809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d76c7f-0978-4504-a1be-f01571156ac8 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.283088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d76c7f-0978-4504-a1be-f01571156ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.283380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d76c7f-0978-4504-a1be-f01571156ac8 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/162eb7d6a9894e4ca60aa8da4537a1ed/roles/79be860b24f44c24aa3d43cf616ffad8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.302076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d76c7f-0978-4504-a1be-f01571156ac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=162eb7d6a9894e4ca60aa8da4537a1ed, role_id=79be860b24f44c24aa3d43cf616ffad8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.303555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d76c7f-0978-4504-a1be-f01571156ac8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.376507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 303/609] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:16 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/162eb7d6a9894e4ca60aa8da4537a1ed/roles/79be860b24f44c24aa3d43cf616ffad8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:16.547124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347314-1966-4118-b4b1-0d143e24eee5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.589033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.616721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e703-0cf3-41b0-bdaf-72569385cff2 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.617019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e703-0cf3-41b0-bdaf-72569385cff2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.617724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e703-0cf3-41b0-bdaf-72569385cff2 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.619053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 304/610] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:16.624505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316855-c1dd-41ef-be25-a5c2a61d363f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.624787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316855-c1dd-41ef-be25-a5c2a61d363f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.625065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316855-c1dd-41ef-be25-a5c2a61d363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.644954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-5f316855-c1dd-41ef-be25-a5c2a61d363f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:16.646783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5f316855-c1dd-41ef-be25-a5c2a61d363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:16.680411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347314-1966-4118-b4b1-0d143e24eee5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.734217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 305/611] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:16.740180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.740895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.741176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.741516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.754403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:16.759342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:16.760819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:16.761642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 307/612] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:16.768563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316855-c1dd-41ef-be25-a5c2a61d363f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:16.867822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:16.874305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316855-c1dd-41ef-be25-a5c2a61d363f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:16.909946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:16.910702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:16.911089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:16.911499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:16.912337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:16.913011 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:16.914721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:16.923646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 306/613] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:16.928874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.050671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.054728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab51c4-9da0-4698-bcd3-b78437eb170d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.092551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.125198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313978a6-2609-4571-8bef-28c57457415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.125796 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313978a6-2609-4571-8bef-28c57457415f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.126083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313978a6-2609-4571-8bef-28c57457415f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.126361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313978a6-2609-4571-8bef-28c57457415f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.138169 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313978a6-2609-4571-8bef-28c57457415f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.139677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313978a6-2609-4571-8bef-28c57457415f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-313978a6-2609-4571-8bef-28c57457415f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:17.155512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:17.156664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:17.157643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:17.157643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:17.157643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:17.157643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 308/614] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:17.162524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313978a6-2609-4571-8bef-28c57457415f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.213889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3caa-e361-4969-9614-0d2d38b29bf3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.256935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.258427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.260005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.260393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.280627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:17.293389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:17.294515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:17.295564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:17.298465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 307/615] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:17.302737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.327719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.349617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313978a6-2609-4571-8bef-28c57457415f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.432882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6a9ed-ef54-49da-a379-7b069081f4c8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.444662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.445283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.445568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.445843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.446499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:17.446804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.448230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.469398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.469798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 309/616] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.470542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.470926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.471306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.472182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:17.472609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.474312 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.474793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.484646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 308/617] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.493942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.497923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.579719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.616305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d738d-36a0-4199-9030-b07cc3d900db None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.655331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.656005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.656349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.656896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.670496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.672013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.685662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe5d7-9bbf-4e66-a0ba-8c09b4f86134 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:17.688408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:17.689360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:17.690230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:17.690230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:17.690230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:17.690230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 309/618] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:17.695763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.780112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.780836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.781127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.781405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.797832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.799296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.816620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab3f80-d3e2-47f8-8721-23198afa0c80 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:17.820804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:17.821740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:17.822704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:17.829096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 310/619] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:17.832383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.846536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:17.865147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:17.865861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:17.866256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:17.866634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:17.867742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:17.884848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:17.884848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:17.884848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 310/620] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:17.893064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:17.982486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.015829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15f2c8-5ad6-4f5e-8a0f-87c2b3696c35 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.080722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.081630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.082075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.082547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.083530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:18.084010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.085605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.102575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ca1d-540f-44af-9c25-7020d7c46e18 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.113954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 311/621] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:18.132587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.152775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.153681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.154126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.154559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.167827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.170386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:18.193829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:18.195148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:18.196426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:18.205075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 311/622] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:18.215439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.313985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213c431-9dbc-4180-af5d-2375b74498ab None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.325010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.332944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ed18-05f5-4f8f-b1eb-c4497d28d1b1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.370335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.380042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b300b0a-f9c1-4f31-91be-e96c791d675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.384365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b300b0a-f9c1-4f31-91be-e96c791d675d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.384365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b300b0a-f9c1-4f31-91be-e96c791d675d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.384365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b300b0a-f9c1-4f31-91be-e96c791d675d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.384603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ae27d-bee9-40d0-b773-dbd6387ec199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.384603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae27d-bee9-40d0-b773-dbd6387ec199 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.384603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae27d-bee9-40d0-b773-dbd6387ec199 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.384603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae27d-bee9-40d0-b773-dbd6387ec199 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.384928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ae27d-bee9-40d0-b773-dbd6387ec199 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:18.384928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ae27d-bee9-40d0-b773-dbd6387ec199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.385530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ae27d-bee9-40d0-b773-dbd6387ec199 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.409124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 312/623] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:18.409124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9009f9-5349-4998-8702-6fc38e122b83 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.409124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9009f9-5349-4998-8702-6fc38e122b83 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.409124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9009f9-5349-4998-8702-6fc38e122b83 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.409124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 313/624] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:18.409845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c744f-339e-42bc-9607-8cf5e0bbb223 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.409976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c744f-339e-42bc-9607-8cf5e0bbb223 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.410256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c744f-339e-42bc-9607-8cf5e0bbb223 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.412594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 314/625] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:18.412594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c744f-339e-42bc-9607-8cf5e0bbb223 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.467783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b300b0a-f9c1-4f31-91be-e96c791d675d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.469239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b300b0a-f9c1-4f31-91be-e96c791d675d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.527244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.531838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c744f-339e-42bc-9607-8cf5e0bbb223 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.570647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d0b7d-1db7-459e-982f-e34aec46a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.571191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b7d-1db7-459e-982f-e34aec46a5ef None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.571504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b7d-1db7-459e-982f-e34aec46a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.571775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b7d-1db7-459e-982f-e34aec46a5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.582738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0b7d-1db7-459e-982f-e34aec46a5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.584253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0b7d-1db7-459e-982f-e34aec46a5ef None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.592334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 312/626] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:34:18.592334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd55f6-f34d-42eb-8d2d-1eaa582c4b53 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.592334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd55f6-f34d-42eb-8d2d-1eaa582c4b53 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.592334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd55f6-f34d-42eb-8d2d-1eaa582c4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-849d0b7d-1db7-459e-982f-e34aec46a5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:18.599881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:18.600884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:18.601769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:18.601769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:18.601769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:18.605880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 315/627] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:18.606984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19653-4fe5-4dfb-9437-3c056459d992 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.607268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19653-4fe5-4dfb-9437-3c056459d992 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.607564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19653-4fe5-4dfb-9437-3c056459d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.610506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b0dd55f6-f34d-42eb-8d2d-1eaa582c4b53 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:18.611739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b0dd55f6-f34d-42eb-8d2d-1eaa582c4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:18.626039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-3bb19653-4fe5-4dfb-9437-3c056459d992 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:18.627257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3bb19653-4fe5-4dfb-9437-3c056459d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:18.641655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.690099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 313/628] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:18.691446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd55f6-f34d-42eb-8d2d-1eaa582c4b53 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.727509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 316/629] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:18.729425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19653-4fe5-4dfb-9437-3c056459d992 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.850836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd55f6-f34d-42eb-8d2d-1eaa582c4b53 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.855713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:18.876371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19653-4fe5-4dfb-9437-3c056459d992 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:18.901419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26826f54-8774-470c-9641-d97a74e3d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.902333 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826f54-8774-470c-9641-d97a74e3d1b2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.902920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826f54-8774-470c-9641-d97a74e3d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.903424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826f54-8774-470c-9641-d97a74e3d1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.914713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc53fa-ef53-4113-b607-7bc63b05438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:18.915511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc53fa-ef53-4113-b607-7bc63b05438a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.915924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc53fa-ef53-4113-b607-7bc63b05438a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.916286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc53fa-ef53-4113-b607-7bc63b05438a None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.917035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc53fa-ef53-4113-b607-7bc63b05438a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:18.917441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc53fa-ef53-4113-b607-7bc63b05438a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.917781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26826f54-8774-470c-9641-d97a74e3d1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:18.919007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc53fa-ef53-4113-b607-7bc63b05438a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.919633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26826f54-8774-470c-9641-d97a74e3d1b2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:18.931856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 317/630] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:18.933265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a229508-668e-4fe2-a54a-6369daa7e9b6 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.933673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a229508-668e-4fe2-a54a-6369daa7e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.934055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a229508-668e-4fe2-a54a-6369daa7e9b6 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-26826f54-8774-470c-9641-d97a74e3d1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:18.938732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:18.939980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:18.940896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:18.940896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:18.940896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:18.941077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 318/631] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:18.941077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a229508-668e-4fe2-a54a-6369daa7e9b6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:18.943143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 314/632] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:18.945889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db89c-ac04-4e93-9631-adcaf0c39431 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:18.946375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db89c-ac04-4e93-9631-adcaf0c39431 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:18.946855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db89c-ac04-4e93-9631-adcaf0c39431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:18.970725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-454db89c-ac04-4e93-9631-adcaf0c39431 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:18.971968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-454db89c-ac04-4e93-9631-adcaf0c39431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:18.974922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.044014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 315/633] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:19.046453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db89c-ac04-4e93-9631-adcaf0c39431 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.054205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a229508-668e-4fe2-a54a-6369daa7e9b6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.089358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.090095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.090443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.090721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.097689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.099157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.102407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:19.111468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:19.112668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 319/634] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:19.113541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.159042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db89c-ac04-4e93-9631-adcaf0c39431 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.205907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.206817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.207106 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.207469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.208126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.208427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.209801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.219856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.227665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 316/635] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.227665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.249382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e5e5-1393-4859-af6b-f788d8a35ace None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.286062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.286692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.286970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.287247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.298585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:19.303779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:19.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 320/636] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:19.306486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.343662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c8d71-b9b0-4d21-a064-e69beda96b2a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.369472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.377430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.378064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.380735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.380735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.389314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:19.394631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:19.395807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 317/637] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:19.396876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.415477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336583e-534d-4b66-9f82-50a9fd43f9fb None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.449768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.450413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.450702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.450988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.451717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.452031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.453469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.457374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.466181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 321/638] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.467186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.498382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e54b4-fbee-4d48-aab3-926ad3af13fc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.532757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.533389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.533671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.533952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.540542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.542050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:19.553373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:19.554582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 318/639] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:19.555669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.575745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601be24d-4ac4-4bdf-921e-4c6151edff2f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.596091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.611286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.611927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.612210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.612479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.613143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.613448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.614835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.623070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 322/640] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.623839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.662997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a04aa-50e5-482d-a63d-7f82d0bae491 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.684662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.698535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.699166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.699478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.699754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.710521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:19.716469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:19.717657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:19.718527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 319/641] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:19.719274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.733096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca009d86-d224-49b0-9179-5a0373bb008a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.770508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.771107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.771413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.771689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.772399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.772706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.774069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.782535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 323/642] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.783349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.829529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:19.829837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ddadf-e3e7-4595-a4b8-26f46658006c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.866789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.867481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.867765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.868043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/bc7bfd9c93404d8ea4260832d1b0e284/roles/79be860b24f44c24aa3d43cf616ffad8` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.883145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=bc7bfd9c93404d8ea4260832d1b0e284, role_id=79be860b24f44c24aa3d43cf616ffad8)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.884451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e664-8486-4669-b31a-2002f9be745a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:19.884563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.917966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:19.918563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:19.918839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:19.919106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:19.919830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:19.920153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:19.921542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:19.933950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 324/643] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:19.934773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.946672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 320/644] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:19 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/bc7bfd9c93404d8ea4260832d1b0e284/roles/79be860b24f44c24aa3d43cf616ffad8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:19.948203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:19.995340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.050189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34f691-ef39-417b-b8d2-9e0d1c3bd433 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.054168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.081069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b12d45-c2c4-4fb0-976e-090a991dcd73 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.091306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.092023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.092307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.092617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.108421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.109979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.123705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.124644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.124644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.124882 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.125492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:20.125793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:20.126881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:20.127806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:20.128869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:20.128869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:20.128869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:20.129050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.129126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 325/645] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:20.129200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.136794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 321/646] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.138892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.239547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.253887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4a183-d6af-4ebd-ae21-7dc29fbce9ce None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.273185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470de60-5754-4fc3-b86a-31f8bab71bf5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.292793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.293405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.293752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.293964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.294699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=79b9a470bced4efcaef3ed849f6963fd) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:20.295011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.296523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.308841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 322/647] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/role_assignments?user.id=79b9a470bced4efcaef3ed849f6963fd&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.308841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.310093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.310850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.311258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.311672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.333482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.335138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:20.350976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:20.352241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:20.353345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:20.353345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:20.353345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:20.359649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 326/648] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:20.359649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.378380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.445558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da6bed-d789-4a40-ae9e-c88783ce4350 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.487324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.488280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.488744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.488880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.489463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:20.489766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.491119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.505774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 323/649] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.506464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.514769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b783e-e394-4625-8449-cc534768d796 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.528297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.565244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.565881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.566157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.566428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.578137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.579933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:20.601305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:20.602303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:20.603175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:20.603175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:20.603175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:20.603175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 327/650] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:20.604453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.647144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7b41-38ff-4a15-836e-2c888bdb7e8b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.675957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.693503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.694172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.694455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.694731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.695554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:20.695920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.697284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.714974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 324/651] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.714974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.735517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb753db-a9cd-4d1e-bfbd-db7e70329ccc None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.787399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.788701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.789358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.789933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.804729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.807754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.815486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:20.822603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:20.830017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 328/652] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:20.831262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.850872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a5e3e-60d5-453e-989a-ee8a0c6566b8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.896284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.897432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.898275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.898720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:20.899785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:20.901109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:20.903317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:20.925307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 325/653] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:20.925307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:20.955617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caca2f-73e9-4719-8147-3ae0c9ad614d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:20.978177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:20.994557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:20.995454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:20.995974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:20.996416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.007274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.009129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:21.023758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:21.024942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:34:21.026693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:21.032853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 329/654] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:21.032853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.057386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cba8b-a7fb-476e-a03b-9f0870c4bcd2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.098294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.099069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.099497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.099881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.100762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:21.101176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.102827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.105823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.122627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 326/655] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:21.124503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.187411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fa27-5344-4451-86c8-bddd1488c171 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.222476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.223348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.223790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.224258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.232847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.233312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ec5f-9b73-4371-acc9-64c7fb661635 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.234646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:21.246726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:21.247856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:34:21.248961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:21.255444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 330/656] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:21.256498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.273169 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.274037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.274456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.274837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.275729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:21.276142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.277854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.301212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 327/657] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:21.301212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.307231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.368319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b3c43-eeec-4461-b0a9-27226d93e412 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.383779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.414394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.415484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.415918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.416809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.431817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81cae-b290-40cc-bbcb-c48e29e385aa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.483798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.484616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.485072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.485524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.486876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:21.487410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.489821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.523820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 328/658] 10.222.0.62 () {56 vars in 1139 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:21.525451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.531564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.534230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.590349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.659310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1786df-4e6e-4650-b721-989258c7c485 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.663804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 331/659] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:21.665042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.675448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.709079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.709692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.709970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.710240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.781388 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94485d31-8f9a-436a-a28c-d1c3c3b31ce4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:21.806980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.809569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.819169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41b23-685e-45de-ba73-4281e234cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:21.819881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41b23-685e-45de-ba73-4281e234cbcb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:21.820174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41b23-685e-45de-ba73-4281e234cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:21.820445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41b23-685e-45de-ba73-4281e234cbcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:21.835325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:21.931593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41b23-685e-45de-ba73-4281e234cbcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:21.933106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41b23-685e-45de-ba73-4281e234cbcb None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:21.941859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 329/660] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:21.945310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:21.955621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.056808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4ccc-f469-440b-8b75-c49293b69c99 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.066879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 332/661] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:22.066879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcecd-b8ed-423d-8e80-216f06c6dcbb None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.066879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcecd-b8ed-423d-8e80-216f06c6dcbb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.066879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcecd-b8ed-423d-8e80-216f06c6dcbb None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.067284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 333/662] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:22.068605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcecd-b8ed-423d-8e80-216f06c6dcbb None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.103294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.104056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.104307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.104524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.113389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.117583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.121196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:22.139069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:22.140303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:22.141208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:22.141208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:22.141208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:22.149217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 330/663] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:22.150416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.178007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcecd-b8ed-423d-8e80-216f06c6dcbb None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.216083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7a2f9-7ace-48fe-871e-57400153c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.216722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7a2f9-7ace-48fe-871e-57400153c602 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.217170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7a2f9-7ace-48fe-871e-57400153c602 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.217432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7a2f9-7ace-48fe-871e-57400153c602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.224601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.228582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7a2f9-7ace-48fe-871e-57400153c602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.230220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7a2f9-7ace-48fe-871e-57400153c602 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-39a7a2f9-7ace-48fe-871e-57400153c602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:22.246168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:22.247223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:22.249212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:22.249212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:22.249212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:22.249212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 334/664] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:22.249212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00e244-ccd4-4d2c-b5e8-8e4174e0926f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.249212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00e244-ccd4-4d2c-b5e8-8e4174e0926f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.249556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00e244-ccd4-4d2c-b5e8-8e4174e0926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.274195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7d00e244-ccd4-4d2c-b5e8-8e4174e0926f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:22.275435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7d00e244-ccd4-4d2c-b5e8-8e4174e0926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:22.276532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274490a-886a-432b-b0a9-24a205c8da64 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.321362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.321925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.322818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.323097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.335394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.336887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:22.354472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:22.355416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:22.356340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:22.356340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:22.356340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:22.356340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 331/665] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:22.356559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.375477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 335/666] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:22.375477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00e244-ccd4-4d2c-b5e8-8e4174e0926f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.403755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.468035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f4767-17ab-485d-ba8b-6d76b4783d91 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.483041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.500721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00e244-ccd4-4d2c-b5e8-8e4174e0926f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.508276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.508901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.509188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.509466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.510287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:22.510596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.512079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.538291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 332/667] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:22.538291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.546519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d431-8db2-4d72-b7a9-474a0642c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.547132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d431-8db2-4d72-b7a9-474a0642c0ff None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.547426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d431-8db2-4d72-b7a9-474a0642c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.547704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d431-8db2-4d72-b7a9-474a0642c0ff None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.548353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d431-8db2-4d72-b7a9-474a0642c0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:22.548674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d431-8db2-4d72-b7a9-474a0642c0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.550025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d431-8db2-4d72-b7a9-474a0642c0ff None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.562220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 336/668] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:22.563425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaedce7-3e0c-4c0e-b6f6-3e4e0f2bc10e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.563738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaedce7-3e0c-4c0e-b6f6-3e4e0f2bc10e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.563976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaedce7-3e0c-4c0e-b6f6-3e4e0f2bc10e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.565385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 337/669] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:22.565925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaedce7-3e0c-4c0e-b6f6-3e4e0f2bc10e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.660824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d022f0-c246-43d5-9df2-6f3a5d0327df None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.671510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.690163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaedce7-3e0c-4c0e-b6f6-3e4e0f2bc10e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.693699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c910fb7-a432-49f6-88fe-e68ec7a2c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.694311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910fb7-a432-49f6-88fe-e68ec7a2c291 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.694583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910fb7-a432-49f6-88fe-e68ec7a2c291 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.694851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910fb7-a432-49f6-88fe-e68ec7a2c291 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.695525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c910fb7-a432-49f6-88fe-e68ec7a2c291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:22.695824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c910fb7-a432-49f6-88fe-e68ec7a2c291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.697216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c910fb7-a432-49f6-88fe-e68ec7a2c291 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.708503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 333/670] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:22.709660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe2f7-9799-4a53-88c1-65b9b16131a4 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.709941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe2f7-9799-4a53-88c1-65b9b16131a4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.710215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe2f7-9799-4a53-88c1-65b9b16131a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.726911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.727125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-916fe2f7-9799-4a53-88c1-65b9b16131a4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:22.727755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.727865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.728120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.728823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-916fe2f7-9799-4a53-88c1-65b9b16131a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:22.735268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.736748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:22.748480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:22.749570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 338/671] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:22.750484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.757958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.799194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 334/672] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:22.800082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe2f7-9799-4a53-88c1-65b9b16131a4 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.859993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063fa1-852e-4b4b-a08c-2347b159e598 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.896282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.896914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.897302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.897592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.905042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:22.906515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:22.926837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:22.927809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 339/673] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:22.928705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:22.931337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:22.935282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe2f7-9799-4a53-88c1-65b9b16131a4 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:22.983900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:22.984542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:22.984823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:22.985099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:22.996637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:23.001638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:23.002552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:23.003388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 335/674] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:23.004095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.034616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.054576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010abe-9cd5-41c2-9418-c9a5f902c293 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.088869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.089499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.089780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.090058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.096732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.098164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:23.109097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:23.110164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 340/675] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:23.111059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.118296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596799c2-4383-4cdb-8102-e715fc5af382 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.152872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.153481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.153764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.154039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.154732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.155042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.156518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.168004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 336/676] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.168825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.176017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.215687 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362a93-d680-4223-8e86-e43e0df9aaae None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.250283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.250889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.251168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.251475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.252171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.252474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.254244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.263104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.266186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 341/677] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.267422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.292986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee81de0-07ec-4d3e-b332-743f421a4994 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.333891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.334511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.334797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.335072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.335779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.336085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.337472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.355250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 337/678] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.355250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.379580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc53d2-c577-43ed-9e54-7fdf9951ce2f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.401426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.412070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.412717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.417053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.417053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.425823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:23.434651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:23.435652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:23.436495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 342/679] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:23.437455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.460137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972e95-cb6c-4194-b97a-652970e8b473 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.494442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.494963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.495243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.495553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.496252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.496559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.498496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.510752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 338/680] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.511593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.520251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.540436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7fcee-cd1a-4d5f-aff3-6f9c8529bf5c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.578630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.579230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.579541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.579817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.580549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=b743dbcea55f4ab7b339eb7dc6e30630) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.580860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.584782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.591255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 343/681] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/role_assignments?user.id=b743dbcea55f4ab7b339eb7dc6e30630&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.592166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.616691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d73bc-cd68-4a45-9b9c-f40f5cbf3d2d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.657050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053857-394b-4776-a697-a3bb167e461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.659711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053857-394b-4776-a697-a3bb167e461f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.659711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053857-394b-4776-a697-a3bb167e461f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.659711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053857-394b-4776-a697-a3bb167e461f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.659711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80053857-394b-4776-a697-a3bb167e461f None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=c1f59dfd806f4d1cada6a42f5fce3b27) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.660416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.661390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80053857-394b-4776-a697-a3bb167e461f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.663147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80053857-394b-4776-a697-a3bb167e461f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.677254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 339/682] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/role_assignments?user.id=c1f59dfd806f4d1cada6a42f5fce3b27&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.677254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053857-394b-4776-a697-a3bb167e461f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.727151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b60c6f-5356-45c0-99e7-75f098dd8c30 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.763694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.772123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.772856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.773144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.773419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.791698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.794096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.811461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053857-394b-4776-a697-a3bb167e461f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:23.812796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:23.813932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:23.815038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:23.815038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:23.815038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:23.815038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 344/683] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:23.815038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.850328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:23.851202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:23.851519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:23.851799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:23.852479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:23.852786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:23.854722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:23.866966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 340/684] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:23.867863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:23.951469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:23.955394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceba48-6560-4cf7-b31a-aa4a929f5023 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.003149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.003809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.004093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.004372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.005217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=162eb7d6a9894e4ca60aa8da4537a1ed) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:24.005537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.007093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.013056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64423ca-901e-4179-9dca-2959ae970e2b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.014605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 345/685] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/role_assignments?user.id=162eb7d6a9894e4ca60aa8da4537a1ed&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:24.015564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.047424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.052966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.053758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.054189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.054569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.055343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:24.055915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.057459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.071448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 341/686] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:24.080757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.154102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611b9ba-b4e4-4c19-8d97-6be36ce35980 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.240811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.241506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.241790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.242067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.256729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.262719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.280138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19b997-1536-47d2-bcf9-f0da0f8d0cff None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:24.285667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:24.286811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:24.287786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:24.287786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:24.287786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:24.287786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 346/687] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:24.309644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.357965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.358728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.359139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.359403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.359675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.372353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.380209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:24.387987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:24.389115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:24.390271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:24.395851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 342/688] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:24.400576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.511772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.522819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f426b6-e7d9-4477-bac8-d33be726cbb7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.600896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2edd6e-dd11-4a52-9621-2d02e8174dcc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.624434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.625003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.625003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.625169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.625851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:24.626258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.627578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.659520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 347/689] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:24.665994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.675388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:24.675388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:24.675388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:24.675388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:24.675926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:24.675926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:24.680894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:24.731908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 343/690] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:24.732868 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:24.938674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad68be-213b-49a6-828a-f404fd46f157 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:24.954415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:24.993304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.006966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.011530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.011831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.012761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.079134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448bdb2-926a-4d07-b190-9b9b81bdccec None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.108610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.110083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.144864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.145527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.145807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.146074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.158447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.159937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:25.182089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:25.183149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:25.184154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 348/691] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:25.197664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.221801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 344/692] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:25.227168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.251697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.367400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e5044-f8cd-4033-9f62-1551c46c20b2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.430128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.430748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.431093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.431418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.432175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:25.432487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.433923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.436515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.439437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4703-667c-4af3-9df2-907e67e944bd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.470414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 349/693] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:25.476172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.511774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.512728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.513045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.513324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.540663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.543801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:25.575787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:25.576786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:25.577661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:25.577661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:25.577661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:25.579897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 345/694] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:25.584247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.672350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.675925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8b053-9138-48ee-a44e-e9925236daaa None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.748196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdc7d1-c72d-44b8-9f8c-94208cea4d9e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.756098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a342e-98eb-44fc-bf36-7f2d7eee455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.757003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a342e-98eb-44fc-bf36-7f2d7eee455f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.757517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a342e-98eb-44fc-bf36-7f2d7eee455f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.758027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a342e-98eb-44fc-bf36-7f2d7eee455f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.784895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.785515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.785799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.786076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.791381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:25.791381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.791381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.801880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 346/695] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:25.807022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:25.884978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.894845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a342e-98eb-44fc-bf36-7f2d7eee455f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.901209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a342e-98eb-44fc-bf36-7f2d7eee455f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.913041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542530-342f-4fbd-aa6b-6f8f6148c40e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:25.947869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:25.952114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146557d-0292-47d2-b342-f8fb74ea5c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:25.952856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146557d-0292-47d2-b342-f8fb74ea5c53 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.953137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146557d-0292-47d2-b342-f8fb74ea5c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.953413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146557d-0292-47d2-b342-f8fb74ea5c53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.961095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146557d-0292-47d2-b342-f8fb74ea5c53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:25.962808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146557d-0292-47d2-b342-f8fb74ea5c53 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-4146557d-0292-47d2-b342-f8fb74ea5c53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:25.975219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:25.976179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:25.977043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 347/696] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:25.983397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9dba-fb73-4b23-bdf1-b7d8ec412854 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:25.983397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9dba-fb73-4b23-bdf1-b7d8ec412854 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:25.983397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9dba-fb73-4b23-bdf1-b7d8ec412854 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:25.983397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 348/697] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:25.983397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec9dba-fb73-4b23-bdf1-b7d8ec412854 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.006893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 350/698] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:34:26.008218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e24cb-ee5f-44ae-8b93-512b539c23df None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.008505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e24cb-ee5f-44ae-8b93-512b539c23df None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.008778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e24cb-ee5f-44ae-8b93-512b539c23df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.028181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fb6e24cb-ee5f-44ae-8b93-512b539c23df None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:26.029379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fb6e24cb-ee5f-44ae-8b93-512b539c23df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:26.099503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec9dba-fb73-4b23-bdf1-b7d8ec412854 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.103651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 351/699] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:26.105432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e24cb-ee5f-44ae-8b93-512b539c23df None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.134229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.140952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc1433-f6f0-48f9-bcc0-93a35b52c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.141756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1433-f6f0-48f9-bcc0-93a35b52c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.142414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1433-f6f0-48f9-bcc0-93a35b52c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.142824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1433-f6f0-48f9-bcc0-93a35b52c4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.143752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1433-f6f0-48f9-bcc0-93a35b52c4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:26.144176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1433-f6f0-48f9-bcc0-93a35b52c4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.146684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1433-f6f0-48f9-bcc0-93a35b52c4b5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.162586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 349/700] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:26.164456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fd5d-5398-4c85-982d-82c2d157373a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.164750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fd5d-5398-4c85-982d-82c2d157373a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.165024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fd5d-5398-4c85-982d-82c2d157373a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.166981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 350/701] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:26.168319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fd5d-5398-4c85-982d-82c2d157373a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.216918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e24cb-ee5f-44ae-8b93-512b539c23df None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.266609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda988d-b140-4bc0-892c-74cbd9e2b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.267444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda988d-b140-4bc0-892c-74cbd9e2b760 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.267726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda988d-b140-4bc0-892c-74cbd9e2b760 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.267995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda988d-b140-4bc0-892c-74cbd9e2b760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.282353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda988d-b140-4bc0-892c-74cbd9e2b760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.284043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda988d-b140-4bc0-892c-74cbd9e2b760 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.284833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fd5d-5398-4c85-982d-82c2d157373a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.291709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-beda988d-b140-4bc0-892c-74cbd9e2b760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:26.300632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:26.302518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:26.305665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:26.305665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:26.305665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:26.310269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 352/702] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:26.310269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eba7-9607-4117-a3c3-f8c5b8934f82 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.310269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eba7-9607-4117-a3c3-f8c5b8934f82 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.310269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eba7-9607-4117-a3c3-f8c5b8934f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.328979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1ef8eba7-9607-4117-a3c3-f8c5b8934f82 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:26.329201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.329683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.329964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.330282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.330487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1ef8eba7-9607-4117-a3c3-f8c5b8934f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:26.331011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=bc7bfd9c93404d8ea4260832d1b0e284) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:26.331381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.333166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.341574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 351/703] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/role_assignments?user.id=bc7bfd9c93404d8ea4260832d1b0e284&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:26.342938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.427682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 353/704] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:26.429530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092917-8103-45c8-b4fb-9eb93433d0c5 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.429888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092917-8103-45c8-b4fb-9eb93433d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.430170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092917-8103-45c8-b4fb-9eb93433d0c5 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.435528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 354/705] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:26.436803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56092917-8103-45c8-b4fb-9eb93433d0c5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.442723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.490878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaa0e8-0f11-472f-adee-97160ac29161 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.500359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.532651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a04aa-3928-413f-905b-c1aba01d7417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.533200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a04aa-3928-413f-905b-c1aba01d7417 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.533483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a04aa-3928-413f-905b-c1aba01d7417 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.533756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a04aa-3928-413f-905b-c1aba01d7417 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.534459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a04aa-3928-413f-905b-c1aba01d7417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:26.535306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a04aa-3928-413f-905b-c1aba01d7417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.537453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a04aa-3928-413f-905b-c1aba01d7417 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.553314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 352/706] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:26.554703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7df00-2d7a-4402-a1f2-18a918a5baa8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.554992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7df00-2d7a-4402-a1f2-18a918a5baa8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.555268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7df00-2d7a-4402-a1f2-18a918a5baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.564489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56092917-8103-45c8-b4fb-9eb93433d0c5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.576848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-79e7df00-2d7a-4402-a1f2-18a918a5baa8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:26.577418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-79e7df00-2d7a-4402-a1f2-18a918a5baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:26.619686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.620335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.620620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.620897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.621494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.622872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:26.635896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:26.636971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:26.638130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:26.639939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 355/707] 10.222.0.62 () {56 vars in 1129 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:26.640387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.676429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 353/708] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:26.683052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7df00-2d7a-4402-a1f2-18a918a5baa8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.738598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.781193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f031bf-e74a-450d-8ce9-1d5b25d3c5c4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.784420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:26.791957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7df00-2d7a-4402-a1f2-18a918a5baa8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.827806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.828399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:26.829033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.829231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:26.829345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.829580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.830027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:26.830448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:26.831226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:26.831830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.833438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.838379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:26.839177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 354/709] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:26.840229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.845768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:26.859903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:26.861013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:26.862112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:26.864224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 356/710] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:26.865323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:26.973688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76263ad3-1d4a-4e7f-a7ce-b0d2cb7184c2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:26.985986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d7d3-7d45-4612-970d-04f27e8524de None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.008973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.010147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.010429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.010701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.018785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.022785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.024545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.027447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.028486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.028771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.034001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.034001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.034001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.034001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.043612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 357/711] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:27.043612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:27.043870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:27.044726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:27.045650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:27.045650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:27.045650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:27.046777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 355/712] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:27.051504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.072618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.180620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf352d-0d30-4e58-af9e-bd9e4b85fc93 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.192637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbf166-3d53-4720-ad62-5328c2a0af87 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.229299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.230182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.230828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.231242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.232082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.232390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.233816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.235151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.235864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.236150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.236423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] PATH_INFO: `/v3/services/network` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.237013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.238355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.250505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 358/713] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:27.251669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:27.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:27.254109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:27.254951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 356/714] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:27.257558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.318191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.340871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.372237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246460a-283b-4376-a6e7-32ecda555967 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.399844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2186ff-3d11-492e-81f8-41bc662e5dee None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.410830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.411826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.412319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.412814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.413782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=79b9a470bced4efcaef3ed849f6963fd) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.414300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.416079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.422275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 357/715] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/role_assignments?user.id=79b9a470bced4efcaef3ed849f6963fd&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:27.423304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.439741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.440461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.440753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.441033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.441690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.442025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.443722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.458713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 359/716] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:27.465327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.575459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdaaf8-7563-491b-badc-242e80634c75 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.591594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e24771-a8bb-480f-ab4a-54808657e4ef None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.616121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.634917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d28502-cc9e-46ce-9863-c9317fc3221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.636267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d28502-cc9e-46ce-9863-c9317fc3221c None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.636803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d28502-cc9e-46ce-9863-c9317fc3221c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.637652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d28502-cc9e-46ce-9863-c9317fc3221c None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.639658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d28502-cc9e-46ce-9863-c9317fc3221c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.642307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d28502-cc9e-46ce-9863-c9317fc3221c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.648268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.649153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.649642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.650153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.653055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] RBAC: Adding query filter params (name=network) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.653597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.655810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.665572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 358/717] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:27.670837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:27.678958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:27.732541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 360/718] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:34:27 2022] POST /identity/v3/users => generated 254 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:27.814842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d434d5-36f1-4076-bf3f-a98215963204 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:27.862884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6219e-d3f6-4d43-8fd1-ed6d47c0df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:27.863961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6219e-d3f6-4d43-8fd1-ed6d47c0df13 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:27.864468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6219e-d3f6-4d43-8fd1-ed6d47c0df13 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:27.865004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6219e-d3f6-4d43-8fd1-ed6d47c0df13 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:27.865855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6219e-d3f6-4d43-8fd1-ed6d47c0df13 None admin] RBAC: Adding query filter params (type=network) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:27.866383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6219e-d3f6-4d43-8fd1-ed6d47c0df13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:27.867987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6219e-d3f6-4d43-8fd1-ed6d47c0df13 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:27.878521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 359/719] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:28.708787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319dafd-82c1-49dd-9f75-7756dfe2278e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.709788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319dafd-82c1-49dd-9f75-7756dfe2278e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.710313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319dafd-82c1-49dd-9f75-7756dfe2278e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.712123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 361/720] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:28.717942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13258b1-4a92-4941-8650-54f1c1e67d3c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:28.718798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13258b1-4a92-4941-8650-54f1c1e67d3c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:28.719278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13258b1-4a92-4941-8650-54f1c1e67d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:28.745784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e13258b1-4a92-4941-8650-54f1c1e67d3c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:28.747397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e13258b1-4a92-4941-8650-54f1c1e67d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:28.828011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:28.834009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 360/721] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:29.174312 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319dafd-82c1-49dd-9f75-7756dfe2278e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:29.295544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894b3a2-1793-4f6b-a5ba-a6863a8493e7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.296182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894b3a2-1793-4f6b-a5ba-a6863a8493e7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.296674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894b3a2-1793-4f6b-a5ba-a6863a8493e7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.298603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 361/722] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:29.304167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f8941-39d3-46aa-badf-bef46aeefd35 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.304737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f8941-39d3-46aa-badf-bef46aeefd35 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.305211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f8941-39d3-46aa-badf-bef46aeefd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.312992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319dafd-82c1-49dd-9f75-7756dfe2278e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:29.338865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-212f8941-39d3-46aa-badf-bef46aeefd35 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:29.340101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-212f8941-39d3-46aa-badf-bef46aeefd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:29.366939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:29.367602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.367884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.368157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.397649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:29.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:29.404012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:29.405046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:29.417619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 362/723] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:29.428554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:29.435257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 362/724] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:34:29.477059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:29.560046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441c7cb-7013-43b8-a90b-a9250cdc4477 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:29.608351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:29.608959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.609239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.609517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.610188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:29.610492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:29.611909 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:29.622938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 363/725] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:29.628128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f8941-39d3-46aa-badf-bef46aeefd35 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:29.792783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f8941-39d3-46aa-badf-bef46aeefd35 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:29.806992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:29.836694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:29.846496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01835b-44b5-4d21-b2fb-aedd73c88f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:29.847154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01835b-44b5-4d21-b2fb-aedd73c88f50 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.847470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01835b-44b5-4d21-b2fb-aedd73c88f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.847936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01835b-44b5-4d21-b2fb-aedd73c88f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.862527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01835b-44b5-4d21-b2fb-aedd73c88f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:29.864091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01835b-44b5-4d21-b2fb-aedd73c88f50 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:29.943814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:29.953983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dc6c5-5f33-4ff6-93fc-57cce2b7a6e2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:29.991840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957b45d-39c6-4ea6-9e60-88fc4206766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:29.992877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b45d-39c6-4ea6-9e60-88fc4206766f None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:29.993469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b45d-39c6-4ea6-9e60-88fc4206766f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:29.994369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b45d-39c6-4ea6-9e60-88fc4206766f None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:29.995828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957b45d-39c6-4ea6-9e60-88fc4206766f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:29.997551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957b45d-39c6-4ea6-9e60-88fc4206766f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-3f01835b-44b5-4d21-b2fb-aedd73c88f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:30.013515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:30.014555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:30.015937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:30.015937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:30.015937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:30.015937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 363/726] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:30.016327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e724d-ff4e-4242-81db-59993152d18f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.016603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e724d-ff4e-4242-81db-59993152d18f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.016868 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e724d-ff4e-4242-81db-59993152d18f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.018277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 364/727] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:30.020268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e724d-ff4e-4242-81db-59993152d18f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:30.109073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 364/728] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:34:29 2022] POST /identity/v3/services => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:30.110688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739c4ef-7682-4f43-8827-6fba67796bda None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.111156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739c4ef-7682-4f43-8827-6fba67796bda None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.111535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739c4ef-7682-4f43-8827-6fba67796bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.137061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0739c4ef-7682-4f43-8827-6fba67796bda None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:30.139894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0739c4ef-7682-4f43-8827-6fba67796bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:30.190743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e724d-ff4e-4242-81db-59993152d18f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:30.230872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:30.231553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.231889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.232163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.232834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:30.233144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:30.234557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:30.239544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 365/729] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:30.241027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1db82-6992-4a46-83d9-0582fb33e288 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.241309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1db82-6992-4a46-83d9-0582fb33e288 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.241582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1db82-6992-4a46-83d9-0582fb33e288 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.247541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 366/730] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:30.252586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b175-b8de-41e0-9030-5a7702364c35 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.253202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b175-b8de-41e0-9030-5a7702364c35 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.253683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b175-b8de-41e0-9030-5a7702364c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.269057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 365/731] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:30.274400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:30.284474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-17d1b175-b8de-41e0-9030-5a7702364c35 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:30.285688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-17d1b175-b8de-41e0-9030-5a7702364c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:30.342020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:30.385707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 367/732] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:30.419417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c454508-52ef-4c25-bdaa-bc103b6842f6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:30.460581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f197-9325-452c-a4c7-6cdb2f6c2723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:30.461600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f197-9325-452c-a4c7-6cdb2f6c2723 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.462090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f197-9325-452c-a4c7-6cdb2f6c2723 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.462616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f197-9325-452c-a4c7-6cdb2f6c2723 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.472216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0f197-9325-452c-a4c7-6cdb2f6c2723 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:30.473934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0f197-9325-452c-a4c7-6cdb2f6c2723 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-11b0f197-9325-452c-a4c7-6cdb2f6c2723 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:30.490675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:30.491696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:30.492616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:30.495747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 366/733] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:30.501630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b175-b8de-41e0-9030-5a7702364c35 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:30.523463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:30.568952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2070b-aac5-4c16-9e05-f0e2ae9439e1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.569286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2070b-aac5-4c16-9e05-f0e2ae9439e1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.569521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2070b-aac5-4c16-9e05-f0e2ae9439e1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.571034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 367/734] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:30.571637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2070b-aac5-4c16-9e05-f0e2ae9439e1 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:30.634915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b175-b8de-41e0-9030-5a7702364c35 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:30.672471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca4d67-91f5-46a8-b459-6048512f62b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:30.673010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca4d67-91f5-46a8-b459-6048512f62b0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.673288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca4d67-91f5-46a8-b459-6048512f62b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.673559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca4d67-91f5-46a8-b459-6048512f62b0 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.674311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca4d67-91f5-46a8-b459-6048512f62b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:30.674614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca4d67-91f5-46a8-b459-6048512f62b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:30.676118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca4d67-91f5-46a8-b459-6048512f62b0 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:30.701636 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 368/735] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:30.703679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a756b-ed34-4c20-9677-c68c2385138c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.704189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a756b-ed34-4c20-9677-c68c2385138c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.704866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a756b-ed34-4c20-9677-c68c2385138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.712790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:30.720770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2070b-aac5-4c16-9e05-f0e2ae9439e1 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:30.724074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-820a756b-ed34-4c20-9677-c68c2385138c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:30.725283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-820a756b-ed34-4c20-9677-c68c2385138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:30.759714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:30.761386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.762892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.763163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.776210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:30.781084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:30.782035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 368/736] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:30.788194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:30.810664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:30.816301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 369/737] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:34:30.818040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a756b-ed34-4c20-9677-c68c2385138c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:30.909695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d23872-4322-40e6-bfbe-bcd05ca55f10 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:30.948024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a756b-ed34-4c20-9677-c68c2385138c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:30.948635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:30.949739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.951096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.951647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:30.984825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:30.986245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:30.986880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:30.987156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:30.987528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.001238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:31.006027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:31.007076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:31.007938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:31.013397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 370/738] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:31.014095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.048934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.051602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.085874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.143061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626fbea-3fb0-45ee-8798-c19d544151e7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.167574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 369/739] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:30 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:34:31.172697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.180462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.181606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.181892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.182162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.182824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:31.183123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.184520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.197999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 371/740] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:31.197999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.233276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.278279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223204-7424-4bfe-83e6-93d63c45ee03 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.306269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ced9a1-ac40-4d9b-8903-614388cbebf1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.313706 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.314316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.314599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.314875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.315566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:31.315872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.317230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.326005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 370/741] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:31.327538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.331271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.341976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.349263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.349556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.350257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.350692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.352222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.416374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 372/742] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:34:31 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:31.417195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.453045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e783d-549f-4637-921a-e45b34c33b3c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.477075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.511922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.513495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.513778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.514053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.529378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.531491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:31.551671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:31.552726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:31.553864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:31.553864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:31.553864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:31.553864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 371/743] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:31.554087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.568112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50ec2-5d22-43ca-9ccd-91869867bb07 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.610595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.611612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.612103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.612561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.628903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.630680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:31.649671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:31.651215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:31.652175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:31.652175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:31.652175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:31.653117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 373/744] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:31.653765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.689885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.700046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000045-e580-458b-b362-3bffffaf8ab4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.744964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.745590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.745875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.746147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.757333 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.760038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.772672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f6791-ad46-49b5-885b-94c73a0f8f35 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:31.777718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:31.778670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:31.779597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:31.779597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:31.779597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:31.779597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 372/745] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:31.780245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.819800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.824993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.826308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.826766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.827288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.828143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:31.828801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.831407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.847319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 374/746] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:31.848230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:31.936521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120155f9-808e-447b-ab01-00f67f7b486a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.975097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:31.975767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:31.976044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:31.976310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:31.976967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:31.977268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:31.979255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:31.981789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:31.991694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a207d-a9c0-4814-8a8e-3fa133b5a645 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:31.998428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 373/747] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:31.999428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.032679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.033401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.033839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.034205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.035016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:32.035540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.037008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.054581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 375/748] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:32.055606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.085937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.112027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd06a5-87d9-4592-9786-08fc05425a0f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.150431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.151293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.151671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.152021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.159545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.160988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:32.174658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:32.175619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:32.176516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:32.180619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 374/749] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:32.181568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.183213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ea9f-4ace-42b6-b9f4-9bd14fd15812 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.222492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.223569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.224084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.224586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] PATH_INFO: `/v3/users/nova` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.234697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.237291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:32.253567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:32.254530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:32.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:32.258841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 376/750] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:32.260698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.281690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.312180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c66a-ed60-4317-a4ca-081749288f17 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.378865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.379881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.380338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.380789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.394760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.397366 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.401069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:32.419839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:32.420858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:32.421781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 375/751] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:32.422614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.431830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40794c9-6424-4eec-90d3-916dd6c153df None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.488395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9eb3b-e0ad-4401-bd55-885f35c5a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.489009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9eb3b-e0ad-4401-bd55-885f35c5a8a5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.489297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9eb3b-e0ad-4401-bd55-885f35c5a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.489577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9eb3b-e0ad-4401-bd55-885f35c5a8a5 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.490312 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9eb3b-e0ad-4401-bd55-885f35c5a8a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:32.490624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9eb3b-e0ad-4401-bd55-885f35c5a8a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.492119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9eb3b-e0ad-4401-bd55-885f35c5a8a5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.505741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 377/752] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:32.506989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be743-1861-4f2a-afb2-459de4b75785 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.507276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be743-1861-4f2a-afb2-459de4b75785 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.507583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be743-1861-4f2a-afb2-459de4b75785 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.508959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 378/753] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:32.514864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be743-1861-4f2a-afb2-459de4b75785 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.560657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef674eaf-9be7-4347-88c8-a1f4c7ff812c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.605912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790449a6-ef4c-486a-aaa0-02495e09022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.606625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790449a6-ef4c-486a-aaa0-02495e09022e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.607050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790449a6-ef4c-486a-aaa0-02495e09022e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.607571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790449a6-ef4c-486a-aaa0-02495e09022e None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.608900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790449a6-ef4c-486a-aaa0-02495e09022e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:32.609403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790449a6-ef4c-486a-aaa0-02495e09022e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.611044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790449a6-ef4c-486a-aaa0-02495e09022e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.616915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.630500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 376/754] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:32.631866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d01f5-615c-456e-bbe2-57f2a9becf0f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.641244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d01f5-615c-456e-bbe2-57f2a9becf0f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.641244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d01f5-615c-456e-bbe2-57f2a9becf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.652521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-168d01f5-615c-456e-bbe2-57f2a9becf0f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:32.653791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-168d01f5-615c-456e-bbe2-57f2a9becf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:32.671514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be743-1861-4f2a-afb2-459de4b75785 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.714347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.714953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.715234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.715619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.717055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:32.717055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.718064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.747057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 379/755] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:32.747057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.752043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.771436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 377/756] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:32.772416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d01f5-615c-456e-bbe2-57f2a9becf0f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.879774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753331b9-6224-4b6e-b869-5c84b18d2ccf None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.898925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d01f5-615c-456e-bbe2-57f2a9becf0f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:32.912586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:32.919747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.920178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.920579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.920908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.930633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=bc7bfd9c93404d8ea4260832d1b0e284) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:32.930633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.930633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:32.937057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 380/757] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/role_assignments?user.id=bc7bfd9c93404d8ea4260832d1b0e284&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:32.937057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:32.963636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:32.964459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:32.965002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:32.965274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:32.988902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:32.991946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:33.018898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:33.019976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:33.021321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:33.021321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:33.021321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:33.021321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 378/758] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:33.028633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.088171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.146938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ef642-916d-427d-a55a-6dc2d24be8f1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.185774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff5efd-ff8e-411d-8e98-3116eb5800d1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.188689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.188689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.188689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.188689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.250606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.251690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.252107 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.252388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.253055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:33.253448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.255485 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.276630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 379/759] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:33.276630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.284937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.293381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.295159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.409466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.414998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf08a4-b791-4be2-b232-4e077d2ac2b1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.424981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 381/760] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:34:33.426212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.480018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.480912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.481261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.481605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.482270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.484543 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:33.497535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:33.498571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:33.499480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:33.504163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 380/761] 10.222.0.62 () {56 vars in 1129 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:33.505243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.544057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.551738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910d138-18c1-4b03-92c8-9a6146ea9a65 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.595327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.596004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.596285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.596552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.603889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.605343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:33.616577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:33.617534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 382/762] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:33.618993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.650746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c52c8-8a54-4cf3-a965-9d796438a10f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.688022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872273cf-fa92-4646-9398-95bd4f2fe05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.688638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872273cf-fa92-4646-9398-95bd4f2fe05a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.688929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872273cf-fa92-4646-9398-95bd4f2fe05a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.689270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872273cf-fa92-4646-9398-95bd4f2fe05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.702231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872273cf-fa92-4646-9398-95bd4f2fe05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.704632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872273cf-fa92-4646-9398-95bd4f2fe05a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-872273cf-fa92-4646-9398-95bd4f2fe05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:33.721069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:33.722275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:33.723184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:33.723184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:33.723184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:33.723184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 381/763] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:33.723826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde7d14-0df8-42c6-b665-162849cbfd98 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.724110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde7d14-0df8-42c6-b665-162849cbfd98 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.724386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde7d14-0df8-42c6-b665-162849cbfd98 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.727397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 382/764] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:33.727397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde7d14-0df8-42c6-b665-162849cbfd98 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.746266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.767336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6113-915c-4ae1-9f7a-737491f58286 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.812149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.812926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.813467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.813843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.815093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:33.815542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.817134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.822668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 383/765] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:33.823658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:33.848292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:33.860007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde7d14-0df8-42c6-b665-162849cbfd98 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.902294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c512ec-862c-44d5-b7c4-0bd114bdf5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.902991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c512ec-862c-44d5-b7c4-0bd114bdf5d0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.903342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c512ec-862c-44d5-b7c4-0bd114bdf5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.903726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c512ec-862c-44d5-b7c4-0bd114bdf5d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.904509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c512ec-862c-44d5-b7c4-0bd114bdf5d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:33.904986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c512ec-862c-44d5-b7c4-0bd114bdf5d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:33.906490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c512ec-862c-44d5-b7c4-0bd114bdf5d0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:33.919489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 383/766] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:33.920822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807b55-7773-4418-90a9-f6b30a143be2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.921110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807b55-7773-4418-90a9-f6b30a143be2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.921384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807b55-7773-4418-90a9-f6b30a143be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:33.940016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ee807b55-7773-4418-90a9-f6b30a143be2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:33.941142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ee807b55-7773-4418-90a9-f6b30a143be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:33.956796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41c38e-99e2-4c60-9c29-ef65f9edebf3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:33.998293 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:33.998901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:33.999177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:33.999476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.000122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:34.000421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.001806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.018456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 384/767] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:34.018456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.031758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 384/768] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:34.031758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807b55-7773-4418-90a9-f6b30a143be2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.033678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.131509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.163953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483d037-c751-4131-b83d-a8f8269584c1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.173442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807b55-7773-4418-90a9-f6b30a143be2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.211579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.213367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.214042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.214466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.215283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:34.215775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.217988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.223101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.223892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.224245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.224588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/79b9a470bced4efcaef3ed849f6963fd/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.225386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 385/769] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:34.226850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=79b9a470bced4efcaef3ed849f6963fd, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.227401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.229159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.306519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 385/770] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:34 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/79b9a470bced4efcaef3ed849f6963fd/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:34.307635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.374154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c0877-daa1-4638-b6e5-c19ee44949cf None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.410125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.426545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.427200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.427535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.427815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.439156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.439156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:34.453949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:34.454918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:34.455836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:34.456929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 386/771] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:34.457023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.459975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.468154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf5d1-ef4c-418b-989a-05011f3fe7b5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.519283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.520159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.520628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.521080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.521886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] RBAC: Adding query filter params (interface=public, service_id=80fa34a8a0984ac6baf188e62b9a00d2, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:34.522197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.523718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.534057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 386/772] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/endpoints?service_id=80fa34a8a0984ac6baf188e62b9a00d2&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:34.535044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.614628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a633a97-934b-4e51-9f63-e925687229b8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.656002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.656583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.656847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.657116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] PATH_INFO: `/v3/services/network` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.657708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.659217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.667487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62961a-3306-4ccf-9323-9841cd85040e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:34.669433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:34.672764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:34.673784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 387/773] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:34.674755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.705963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.716386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.717736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.718258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.718714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.719789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:34.720626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.722759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.740292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 387/774] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:34.741435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.780056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:34.812897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc2bbe-64dc-469d-8b6a-9ffa8bb79d4a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.859039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.860089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.860378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.860671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.861285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.862690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.871509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d283b-5c5d-427f-b6a9-cf785fde0158 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:34.875984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 388/775] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:34.877100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:34.921738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:34.922881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:34.923441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:34.924148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:34.925626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] RBAC: Adding query filter params (name=network) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:34.926491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:34.928698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:34.935987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 388/776] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:34.941606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:35.034294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:35.068491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7f39a-fc9f-4040-b51a-3fce6b2ed225 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:35.100434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3c702-d80a-4aa7-bc59-fba15fc2ef88 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:35.111212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:35.119149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28cc45-3a9c-4dc6-b3cb-517fc059d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:35.119878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cc45-3a9c-4dc6-b3cb-517fc059d5ea None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.120176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cc45-3a9c-4dc6-b3cb-517fc059d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.120454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cc45-3a9c-4dc6-b3cb-517fc059d5ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.121193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28cc45-3a9c-4dc6-b3cb-517fc059d5ea None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=75c6915ce17943a4b9c6c5f4a166a22c) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:35.122236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28cc45-3a9c-4dc6-b3cb-517fc059d5ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:35.123043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28cc45-3a9c-4dc6-b3cb-517fc059d5ea None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:35.134867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 389/777] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/role_assignments?user.id=75c6915ce17943a4b9c6c5f4a166a22c&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:35.135620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a1210-eb6d-4168-ba9a-98ec2542aa20 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.135911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a1210-eb6d-4168-ba9a-98ec2542aa20 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.136184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a1210-eb6d-4168-ba9a-98ec2542aa20 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.138194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 390/778] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:35.151392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d8821-eaaa-407e-a81f-42ef3098c0dc None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.151392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d8821-eaaa-407e-a81f-42ef3098c0dc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.151392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d8821-eaaa-407e-a81f-42ef3098c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.154913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:35.155616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.155906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.156183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.157051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] RBAC: Adding query filter params (type=network) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:35.157366 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:35.159186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:35.171117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 389/779] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:35.176895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:35.182135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-5e9d8821-eaaa-407e-a81f-42ef3098c0dc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:35.183393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5e9d8821-eaaa-407e-a81f-42ef3098c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:35.316644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 391/780] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:34:35.342195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739fc2f-2153-4ebb-a075-182cba7cf472 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:35.362768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:35.389018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:35.389648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.389934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.390208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.390927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] RBAC: Adding query filter params (interface=public, service_id=afc733101dbe447182568ead32fc2135, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:35.391236 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:35.392716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:35.401663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 390/781] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:34:35 2022] GET /identity/v3/endpoints?service_id=afc733101dbe447182568ead32fc2135&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:35.406749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d8821-eaaa-407e-a81f-42ef3098c0dc None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:35.554313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d8821-eaaa-407e-a81f-42ef3098c0dc None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:35.585358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:35.601648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:35.602274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.602554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.603418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.604211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:35.605603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:35.611883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 392/782] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:34:35 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:35.760738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:35.927284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e71081-1173-4ebc-9a5e-3b8920b22062 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:35.980211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:35.981695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:35.982280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:35.982759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:35.998149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:36.004665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:36.005631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:36.006484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:36.010008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 391/783] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:36.016367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.137761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56337d1-921a-4032-b38b-3d9e6c1a6c06 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.182065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.182600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.182881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.183155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.183872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:36.184182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:36.185560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:36.198051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 393/784] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:36.203714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.272445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.330031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6c3c-47fd-4b06-bb7d-36e549f0122c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.368085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b143b1-b685-426c-a4f9-44aa0565aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.369312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b143b1-b685-426c-a4f9-44aa0565aadd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.369593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b143b1-b685-426c-a4f9-44aa0565aadd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.369925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b143b1-b685-426c-a4f9-44aa0565aadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.382669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b143b1-b685-426c-a4f9-44aa0565aadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:36.386607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b143b1-b685-426c-a4f9-44aa0565aadd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-50b143b1-b685-426c-a4f9-44aa0565aadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:36.404104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:36.405100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:36.405964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:36.405964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:36.405964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:36.405964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 392/785] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:36.416848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.482616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1e27-6815-4d5b-868d-13230b33eb1e None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.482911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1e27-6815-4d5b-868d-13230b33eb1e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.483102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1e27-6815-4d5b-868d-13230b33eb1e None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.484513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 393/786] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:36.489831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27791ac-1b6c-4bb7-acd9-042920b007c8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.490400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27791ac-1b6c-4bb7-acd9-042920b007c8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.490891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27791ac-1b6c-4bb7-acd9-042920b007c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.491558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.525253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d27791ac-1b6c-4bb7-acd9-042920b007c8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:36.526806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d27791ac-1b6c-4bb7-acd9-042920b007c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:36.561307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c670ac1-37b6-4ab4-8697-b8a210c7a86d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.601984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.603541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.603829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.604276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.606255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:36.608256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:36.616238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:36.629852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 394/787] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:36.636432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.660075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 394/788] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:34:36.788837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf431e6-051d-45c2-9806-fce85eb77500 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:36.811286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.842674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:36.843386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:36.843672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:36.844032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:36.854931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:36.856450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:36.871883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:36.872905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:36.873853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 395/789] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:36.880766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27791ac-1b6c-4bb7-acd9-042920b007c8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:36.908623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:36.988880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.029531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27791ac-1b6c-4bb7-acd9-042920b007c8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.103660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.107267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.107853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.108354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.109320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.112039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.113727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.152962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 395/790] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.159088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.166931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df01a0-5746-477c-9e91-ab89d68b1a4c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.229902 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95b558-8ef1-4a99-92e6-ba721880dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.230545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95b558-8ef1-4a99-92e6-ba721880dbdf None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.230824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95b558-8ef1-4a99-92e6-ba721880dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.231096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95b558-8ef1-4a99-92e6-ba721880dbdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.249239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95b558-8ef1-4a99-92e6-ba721880dbdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-cb95b558-8ef1-4a99-92e6-ba721880dbdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:37.256368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.257381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:37.258237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:37.261388 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 396/791] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.263314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8dab-4aea-44a2-9261-fd196f5275d6 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.264224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8dab-4aea-44a2-9261-fd196f5275d6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.264655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8dab-4aea-44a2-9261-fd196f5275d6 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.270939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 397/792] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:37.272034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8dab-4aea-44a2-9261-fd196f5275d6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.292009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.310797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.313463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b854ad-26c6-4142-a9be-cb9c183a0b9d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.365018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd55b-def1-408a-a5b8-4cdf4a6d816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.365722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd55b-def1-408a-a5b8-4cdf4a6d816f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.366097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd55b-def1-408a-a5b8-4cdf4a6d816f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.366458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd55b-def1-408a-a5b8-4cdf4a6d816f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.380029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd55b-def1-408a-a5b8-4cdf4a6d816f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.382350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd55b-def1-408a-a5b8-4cdf4a6d816f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a25dd55b-def1-408a-a5b8-4cdf4a6d816f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:37.399013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.400841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:37.401942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:37.401942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.401942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:37.407869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 396/793] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:37.407869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96b530-5c2d-4eee-a338-04121835f10b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.407869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96b530-5c2d-4eee-a338-04121835f10b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.407869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96b530-5c2d-4eee-a338-04121835f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.421692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8dab-4aea-44a2-9261-fd196f5275d6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.427699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8d96b530-5c2d-4eee-a338-04121835f10b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:37.428950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8d96b530-5c2d-4eee-a338-04121835f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:37.461050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.461669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.462020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.463293 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.463622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.463953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.465431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.479291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 398/794] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.480427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.506441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 397/795] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:37.507510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96b530-5c2d-4eee-a338-04121835f10b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.595403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.596965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.608322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33482473-5079-4676-9f2c-891139c898a9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.650571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96b530-5c2d-4eee-a338-04121835f10b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.652585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9af43-a6c9-44ab-bb51-71ce07145e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.653382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9af43-a6c9-44ab-bb51-71ce07145e45 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.653763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9af43-a6c9-44ab-bb51-71ce07145e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.654137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9af43-a6c9-44ab-bb51-71ce07145e45 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.654897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9af43-a6c9-44ab-bb51-71ce07145e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:37.655306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9af43-a6c9-44ab-bb51-71ce07145e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.656820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9af43-a6c9-44ab-bb51-71ce07145e45 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.674306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 399/796] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:37.675953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827b0b-94a2-4861-a3f4-7662a1241fc4 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.676360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827b0b-94a2-4861-a3f4-7662a1241fc4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.676843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827b0b-94a2-4861-a3f4-7662a1241fc4 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.678567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 400/797] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:37.681982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2827b0b-94a2-4861-a3f4-7662a1241fc4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.694387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdd9b8-54ba-4a08-900f-7318359cf6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.695027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd9b8-54ba-4a08-900f-7318359cf6b8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.695307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd9b8-54ba-4a08-900f-7318359cf6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.696759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd9b8-54ba-4a08-900f-7318359cf6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.709182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdd9b8-54ba-4a08-900f-7318359cf6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.711508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdd9b8-54ba-4a08-900f-7318359cf6b8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-79cdd9b8-54ba-4a08-900f-7318359cf6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:37.731522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.732886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:37.734388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:37.734388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:37.734388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:37.734388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 398/798] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.734770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57e76-b616-46da-a881-1a5b2d266b2d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.734770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57e76-b616-46da-a881-1a5b2d266b2d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.735403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57e76-b616-46da-a881-1a5b2d266b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.758287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8bf57e76-b616-46da-a881-1a5b2d266b2d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:37.760608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8bf57e76-b616-46da-a881-1a5b2d266b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:37.822565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2827b0b-94a2-4861-a3f4-7662a1241fc4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:37.843067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 399/799] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:37.852344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57e76-b616-46da-a881-1a5b2d266b2d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.868644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:37.870131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:37.870602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:37.871107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:37.882113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:37.884600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:37.900667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:37.901599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:37.902488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:37.905181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 401/800] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:37.906635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:37.925121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.932070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:37.999129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57e76-b616-46da-a881-1a5b2d266b2d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.032392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37bd9-6f09-46f6-97a8-4ebf229ce1f8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.037074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.037835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.038220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.038597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.039354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.039989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.041466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.060443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 400/801] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.061551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.074278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.075292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.075811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.076302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.077118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.078952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:38.088908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:38.089946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:34:38.090783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:38.098473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 402/802] 10.222.0.62 () {56 vars in 1129 bytes} [Thu Aug 18 20:34:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:38.099826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.189861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cccf8-cd2b-4e24-83e1-ad00ced55ffb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.191684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.194947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.219684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4145c49-80dc-4c12-a0e3-1cb3888d8899 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.232081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.233498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.234166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.234849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.236439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.237220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.239961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.259019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 401/803] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.260508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.266816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.267559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.267912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.268198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.276849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.278053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:38.289626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:38.291485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:34:38.292711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:38.295931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 403/804] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:38.296848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.410272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be44ea-78cb-4f5d-80c4-cb67281858dc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.415809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9576c-37aa-40b0-bc0d-9769263cad29 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.456458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.456842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.457183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.457386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.458019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.458319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.458722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.459519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.459717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.459987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.460372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.464358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.469264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 402/805] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.469264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.479610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:38.484560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:38.486112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:38.487431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:38.490521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 404/806] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:38.491352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.501177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.577232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f30b1-e16f-4de9-9a27-33acab4eb46b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.610960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48175f-84fb-48c4-95b9-4e46334129d4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.622128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598de3ef-ca68-4446-b457-77b693d2bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.622787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de3ef-ca68-4446-b457-77b693d2bf68 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.623069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de3ef-ca68-4446-b457-77b693d2bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.623346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de3ef-ca68-4446-b457-77b693d2bf68 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/bc7bfd9c93404d8ea4260832d1b0e284/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.625461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598de3ef-ca68-4446-b457-77b693d2bf68 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=bc7bfd9c93404d8ea4260832d1b0e284, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.626910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598de3ef-ca68-4446-b457-77b693d2bf68 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.655662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.656282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.656560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.658175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.658175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.658175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.660326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.678808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 405/807] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.679694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.723969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 403/808] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:38 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/bc7bfd9c93404d8ea4260832d1b0e284/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:38.725532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14794a2a-d8ea-4289-ac17-a778e97294fc None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.725822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14794a2a-d8ea-4289-ac17-a778e97294fc None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.726097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14794a2a-d8ea-4289-ac17-a778e97294fc None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.731794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 404/809] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:38.731794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14794a2a-d8ea-4289-ac17-a778e97294fc None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.856151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.864690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:38.884668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14794a2a-d8ea-4289-ac17-a778e97294fc None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.912937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1778907-ca1e-481a-b41d-fa991f6d24bd None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:38.924022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.924639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.924926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.925200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.925883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.926190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.927598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.940315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 405/810] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.940315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:38.959618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e2b35-2a87-469d-b540-e6b4ef3460e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:38.960244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e2b35-2a87-469d-b540-e6b4ef3460e3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.960524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e2b35-2a87-469d-b540-e6b4ef3460e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.960790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e2b35-2a87-469d-b540-e6b4ef3460e3 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.962478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e2b35-2a87-469d-b540-e6b4ef3460e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:38.962943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e2b35-2a87-469d-b540-e6b4ef3460e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:38.964658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e2b35-2a87-469d-b540-e6b4ef3460e3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:38.971184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 406/811] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:38.972555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd16c4d-e9ca-4dca-991c-86f419836f03 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:38.972846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd16c4d-e9ca-4dca-991c-86f419836f03 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:38.973115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd16c4d-e9ca-4dca-991c-86f419836f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:38.993839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7fd16c4d-e9ca-4dca-991c-86f419836f03 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:38.995641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7fd16c4d-e9ca-4dca-991c-86f419836f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:39.060799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a797ff-a71a-4a65-9e3b-45c8623f168f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.085002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 407/812] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:39.085002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd16c4d-e9ca-4dca-991c-86f419836f03 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.108987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.109753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.110113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.110518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.134363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.157246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.197714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.199492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.229578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd16c4d-e9ca-4dca-991c-86f419836f03 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.276299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.277394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.277820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.279043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.294073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.296089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.312712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 406/813] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:34:39.313818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:39.315255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.317145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:39.318310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:39.318310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.318310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:39.325921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 408/814] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.327601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.390240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.445167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690f076-dd9e-4370-b5b4-aa0fc4bed36f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.451681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.454761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82053c9c-f1bb-469f-9773-139b869a3024 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.484606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.485212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.485482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.485749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.486412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.487824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.496501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.497140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.497451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.497711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.511606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.512650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:39.528335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.529497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:39.530385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:39.530385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:39.530385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:39.530385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 409/815] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.530385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.619398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 407/816] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:34:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:39.619398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.658448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48078b9-216b-4221-b37c-ce5d34cf592d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.728823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.729715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.730002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.730273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.730942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:39.731778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.733527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.750022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 410/817] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:39.751063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.768587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.770828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78b7d-f234-49bf-90a5-63c25d13eeca None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.784212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:39.817566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.818592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.818592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.818788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] PATH_INFO: `/v3/services/network` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.819329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.820722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:39.837468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:39.838535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:39.839403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 408/818] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:39.840200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:39.901489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4f0da-8598-4816-8960-9649b34ef271 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.955642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7b68f-21b3-406a-989f-c5a5cdd4bb4a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:39.960430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:39.961158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:39.961527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:39.962477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:39.963226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:39.963661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:39.965126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:39.985873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 411/819] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:39.985873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.000030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.000673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.000958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.001233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.009755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.011206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:40.024947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:40.026004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:40.026923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 409/820] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:40.027664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.062571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.068258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.108265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc204-a625-4576-848f-dfdb6ba0eee4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.140926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a3d9-8a7f-4177-af6c-48322f6036d2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.147302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.148284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.148890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.150041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.150942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.151498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.153250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.158802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 412/821] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.160003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.180721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.181458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.181741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.182015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.189224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.190748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:40.202978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:40.203976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:40.204871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 410/822] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:40.205349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.277792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982509a9-7f19-4eb3-8c27-25f966d8a1b9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.304700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.330153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.330334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66b58c-6646-47b3-b30d-d4dc330e787d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.330419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.330419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.330419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.330419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.330706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.330706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.330706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.355418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 413/823] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.356992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.375499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.376843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.377825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.378430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.379626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] RBAC: Adding query filter params (type=network) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.380131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.382187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.390466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 411/824] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.392313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.486801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd934-e19d-48aa-9d41-7c8ad954cb88 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.516145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb445d6-88fc-400d-81ac-65de3d9277af None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.536210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.537081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.537541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.538458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.539639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.540676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.543136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.557604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.558495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.558975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.559457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.563252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 414/825] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.564216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.572291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.574588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:40.595843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:40.597030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:40.598156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:40.598156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:40.598156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:40.600404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 412/826] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:40.602022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.614249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.623145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.681225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d65eb-677d-43ae-bdd3-230385d58509 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.719669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd2c38-4cd0-43d1-8085-88a88d381d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.720430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2c38-4cd0-43d1-8085-88a88d381d2f None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.720813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2c38-4cd0-43d1-8085-88a88d381d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.721183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2c38-4cd0-43d1-8085-88a88d381d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.721974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd2c38-4cd0-43d1-8085-88a88d381d2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.723614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd2c38-4cd0-43d1-8085-88a88d381d2f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.739989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4bf8b-8b6f-4ab8-9f82-a57c7ab0a4d1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:40.775434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:40.776045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.776328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.776623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.777334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=79b9a470bced4efcaef3ed849f6963fd) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:40.777643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:40.779073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:40.784775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 413/827] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/role_assignments?user.id=79b9a470bced4efcaef3ed849f6963fd&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:40.785550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:40.815614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 415/828] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:34:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:40.819531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4b08-ce10-4fc5-9572-37204578bd82 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.819531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4b08-ce10-4fc5-9572-37204578bd82 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.819531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4b08-ce10-4fc5-9572-37204578bd82 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.822852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 416/829] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:40.827139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80535399-509e-41ba-845e-3467dfd6146e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:40.827844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80535399-509e-41ba-845e-3467dfd6146e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:40.828199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80535399-509e-41ba-845e-3467dfd6146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:40.867451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-80535399-509e-41ba-845e-3467dfd6146e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:40.872899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-80535399-509e-41ba-845e-3467dfd6146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:40.970013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:40.985407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 417/830] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:41.010649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bc078-cd1d-421f-a945-a4d640f38e3e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.049175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.049789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.050071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.050351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.051001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:41.051306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.052702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.068794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 414/831] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:41.074514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80535399-509e-41ba-845e-3467dfd6146e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.108467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:41.203834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80535399-509e-41ba-845e-3467dfd6146e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.245761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.246411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.246689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.246962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.254289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.255681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:41.267985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:41.268927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:41.270042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 418/832] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:41.277816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.329279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.396728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801ed25-896d-46be-ab44-91d0db32b497 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.427760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:41.433939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.434440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.442531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.442531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.442531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:41.442531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.442823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:41.442916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.448402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9397-c9b9-4a9c-a4b8-7e26210dbdf1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.455624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 415/833] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:41.457755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.487323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.489539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.489539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.489539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.500521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:41.506916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:41.507913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:34:41.509339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:41.516760 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 419/834] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:41.518387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.569906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9dee-edfd-4312-b115-d41100c44d13 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.609927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1479de-ebe2-4e3b-8644-65895f5e2667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.610597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1479de-ebe2-4e3b-8644-65895f5e2667 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.610882 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1479de-ebe2-4e3b-8644-65895f5e2667 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.611164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1479de-ebe2-4e3b-8644-65895f5e2667 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/75c6915ce17943a4b9c6c5f4a166a22c/roles/79be860b24f44c24aa3d43cf616ffad8` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.627791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1479de-ebe2-4e3b-8644-65895f5e2667 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=75c6915ce17943a4b9c6c5f4a166a22c, role_id=79be860b24f44c24aa3d43cf616ffad8)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.629216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1479de-ebe2-4e3b-8644-65895f5e2667 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.630202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750fa2-49cc-45ec-804d-1a8c613e7854 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.667592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ff2fa-f5f9-4544-bf2a-98db5816cb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.668320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff2fa-f5f9-4544-bf2a-98db5816cb8b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.668672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff2fa-f5f9-4544-bf2a-98db5816cb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.669021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff2fa-f5f9-4544-bf2a-98db5816cb8b None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.669764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ff2fa-f5f9-4544-bf2a-98db5816cb8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:41.670137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ff2fa-f5f9-4544-bf2a-98db5816cb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.671629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ff2fa-f5f9-4544-bf2a-98db5816cb8b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.680958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 420/835] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:41.686229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0127b-3bdc-4741-953a-4301902177d2 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.686521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0127b-3bdc-4741-953a-4301902177d2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.686819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0127b-3bdc-4741-953a-4301902177d2 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.688148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 421/836] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:41.688838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0127b-3bdc-4741-953a-4301902177d2 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:41.699476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 416/837] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:41 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/75c6915ce17943a4b9c6c5f4a166a22c/roles/79be860b24f44c24aa3d43cf616ffad8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:41.699476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87800ea-08c2-4fa5-8dce-e3de248a4953 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.699476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87800ea-08c2-4fa5-8dce-e3de248a4953 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.699476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87800ea-08c2-4fa5-8dce-e3de248a4953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.718595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a87800ea-08c2-4fa5-8dce-e3de248a4953 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:41.719256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:41.719795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a87800ea-08c2-4fa5-8dce-e3de248a4953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:41.761161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:41.807803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 417/838] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:34:41.838548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0127b-3bdc-4741-953a-4301902177d2 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:41.880138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:41.880772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:41.881053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:41.881327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:41.893056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:41.894511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:41.909948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:41.910920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:41.912217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:41.912217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:41.912217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:41.912217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 422/839] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:41.917778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87800ea-08c2-4fa5-8dce-e3de248a4953 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.025759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87800ea-08c2-4fa5-8dce-e3de248a4953 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.061838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.062453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.062787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.063068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.063802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:42.064114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:42.065490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:42.072937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.078531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 418/840] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:42.084080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.118987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:42.145709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:42.185773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11859ed-f403-44fa-bc64-a789afefccc7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.203853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9b174-ebd6-413f-917b-8f4854e574bd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.224266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.224927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.225281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.225560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.226256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:42.227732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:42.237058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:42.238064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:42.238975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 423/841] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:42.246139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.248783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.249506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.249885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.250363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.260185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:42.262588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:42.276768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:42.277691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:34:42.278619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:42.281348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 419/842] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:42.287172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.370976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d5f9-d263-4b12-8afd-3ac217aae8df None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.404352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:42.408864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:42.412164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.413087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.413620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.414110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.415004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:42.415548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:42.417132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:42.420117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7329a5-4557-4e53-b131-22fa754dd025 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.427271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 424/843] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:42.428556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.465571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.468104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.468388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.468660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.469440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:42.469750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:42.471187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:42.501300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 420/844] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:42.503344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.575334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d3bd-2157-4e0a-9d16-02600a8ade4e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.620042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.621119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.621900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.622605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.623463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:42.623951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:42.624488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64ff57-dc01-4118-819c-8a571ff61693 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:42.626317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:42.635423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 425/845] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:42.685575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0856a-a433-469d-8860-134c5927900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:42.686615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0856a-a433-469d-8860-134c5927900d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.687080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0856a-a433-469d-8860-134c5927900d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.687566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0856a-a433-469d-8860-134c5927900d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.724828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:42.787563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0856a-a433-469d-8860-134c5927900d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:42.789119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0856a-a433-469d-8860-134c5927900d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:42.919754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 421/846] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:34:42.925866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:42.970832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a4a4-6f0b-4c26-9f22-f9401c317497 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.971208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a4a4-6f0b-4c26-9f22-f9401c317497 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.971461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a4a4-6f0b-4c26-9f22-f9401c317497 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.973061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 422/847] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:42.978308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e17ef2-9baa-49c4-ab37-8efd2be67637 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:42.978586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e17ef2-9baa-49c4-ab37-8efd2be67637 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:42.978864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e17ef2-9baa-49c4-ab37-8efd2be67637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:42.995141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:42.999386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e2e17ef2-9baa-49c4-ab37-8efd2be67637 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:43.000587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e2e17ef2-9baa-49c4-ab37-8efd2be67637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:43.055204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a6d41-cec3-4c20-8705-606c28b7524e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.070451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.096724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.097192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.097469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.097755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.110343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 423/848] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:34:43.114579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.116348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:43.132237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:43.133225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:43.134719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:43.134719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:43.134719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:43.136852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 426/849] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:43.143747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e17ef2-9baa-49c4-ab37-8efd2be67637 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.270226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e17ef2-9baa-49c4-ab37-8efd2be67637 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.309123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.309741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.310020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.310293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.310943 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:43.311245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.312681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.326076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 424/850] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:43.331589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.409612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.459832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.468690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1a7f-7b66-4c46-ac44-dcaed2034ed5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.480653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.506034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.506666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.506997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.507244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.514922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.516403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:43.528281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:43.529218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:43.530109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:43.534520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce16e3-149c-49db-95ad-aae580397a81 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.535334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 427/851] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:43.536817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.580616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.581312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.581602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.581884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.582550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.584405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:43.596158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:43.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:43.598075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:43.606138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 425/852] 10.222.0.62 () {56 vars in 1132 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:43.607408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.657744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a663e3-c9ec-4384-b469-ef922cacf5d0 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.703324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.703997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.704277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.704552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.705648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:43.705964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.707631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.729554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 428/853] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:43.730639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.744652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378cb1-1109-4213-a2dd-328bb156b6ba None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.746985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.775214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:43.786858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe82789-291b-4bdd-91af-2b240cec01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.787834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe82789-291b-4bdd-91af-2b240cec01ed None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.788358 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe82789-291b-4bdd-91af-2b240cec01ed None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.788839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe82789-291b-4bdd-91af-2b240cec01ed None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.791096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe82789-291b-4bdd-91af-2b240cec01ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:43.791096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe82789-291b-4bdd-91af-2b240cec01ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.792133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe82789-291b-4bdd-91af-2b240cec01ed None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.800233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 426/854] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:43.802440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8a48-3f03-4f5d-b246-8306f301a2f8 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.803016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8a48-3f03-4f5d-b246-8306f301a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.803622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8a48-3f03-4f5d-b246-8306f301a2f8 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.806798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 427/855] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:43.810302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8a48-3f03-4f5d-b246-8306f301a2f8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:43.889059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7d114-1e9b-4e4c-9298-f955e269657f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:43.933177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078383-1606-4517-a52a-d59f3afd5ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:43.933791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078383-1606-4517-a52a-d59f3afd5ec6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.934073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078383-1606-4517-a52a-d59f3afd5ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.934348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078383-1606-4517-a52a-d59f3afd5ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.935087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078383-1606-4517-a52a-d59f3afd5ec6 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=bc7bfd9c93404d8ea4260832d1b0e284) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:43.935424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078383-1606-4517-a52a-d59f3afd5ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:43.936872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078383-1606-4517-a52a-d59f3afd5ec6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:43.944997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 429/856] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/role_assignments?user.id=bc7bfd9c93404d8ea4260832d1b0e284&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:43.946250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c06d-675b-4179-a91c-b904f42a55db None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:43.946534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c06d-675b-4179-a91c-b904f42a55db None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:43.946807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c06d-675b-4179-a91c-b904f42a55db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:43.967482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8559c06d-675b-4179-a91c-b904f42a55db None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:43.968747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8559c06d-675b-4179-a91c-b904f42a55db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:43.969491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8a48-3f03-4f5d-b246-8306f301a2f8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.030942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.032294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.032875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.033594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.034973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:44.035552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.037364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.045758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 428/857] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:44.067833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 430/858] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:44.342254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.378297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.453762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94569e6-ef82-4753-88df-d40ec2747327 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.490304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.490954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.491234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.491538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.502786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:44.507966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:44.509509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:34:44.510355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:44.510998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 429/859] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:44.516271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559c06d-675b-4179-a91c-b904f42a55db None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.543211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.625233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559c06d-675b-4179-a91c-b904f42a55db None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.666990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976d4f-44b8-4889-8180-7aac8c3e377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.668060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976d4f-44b8-4889-8180-7aac8c3e377d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.668492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976d4f-44b8-4889-8180-7aac8c3e377d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.668915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976d4f-44b8-4889-8180-7aac8c3e377d None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.669772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976d4f-44b8-4889-8180-7aac8c3e377d None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:44.670239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976d4f-44b8-4889-8180-7aac8c3e377d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.671823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976d4f-44b8-4889-8180-7aac8c3e377d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.687910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 431/860] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:44.696556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.755233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7f89-1f93-41b7-9400-537a853f1910 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.755569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7f89-1f93-41b7-9400-537a853f1910 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.755894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7f89-1f93-41b7-9400-537a853f1910 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.757435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 432/861] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:44.762592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd562-94ba-4bbe-9a32-fecfa07d7e90 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.762871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd562-94ba-4bbe-9a32-fecfa07d7e90 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.763141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd562-94ba-4bbe-9a32-fecfa07d7e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.784544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-05acd562-94ba-4bbe-9a32-fecfa07d7e90 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:44.785610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-05acd562-94ba-4bbe-9a32-fecfa07d7e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:44.810664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:44.823942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d2bd9-6608-4d94-abdb-dd2315ea4c7b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:44.875499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:44.875499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:44.875499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:44.875499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:44.876286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 433/862] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:34:44.885623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:44.887389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:44.903028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:44.904064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:44.904956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:44.904956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:44.904956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:44.909057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 430/863] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:44.910655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acd562-94ba-4bbe-9a32-fecfa07d7e90 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:44.930853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.024076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acd562-94ba-4bbe-9a32-fecfa07d7e90 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.078521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.079515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.079949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.080432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.081383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:45.081693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.083134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.101092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 434/864] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:45.102502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.185386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.220686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa82c-666f-4ab7-b7b4-bcbc0780f263 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.268057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.269118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.269600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.270070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.279212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.281700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.292835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:45.297996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:45.299205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:45.300383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:45.302872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 431/865] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:45.309782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.313699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.323160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa3702-3cc2-4eb1-8329-53a549654048 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.369832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.370862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.371409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.371906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.372827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.374683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.438042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1b76-0413-4036-a691-3dbf176dc6dc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.458824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 435/866] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:34:45 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:45.506920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.507662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.507952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.508311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.509613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:45.509927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.511525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.539619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 432/867] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:45.541063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.670409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de157f4-e9a0-4828-bf5e-a4f3e1d073db None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:45.707884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e520c-ec28-4a87-ade5-ae5a25c94c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:45.708428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e520c-ec28-4a87-ade5-ae5a25c94c9b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:45.708709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e520c-ec28-4a87-ade5-ae5a25c94c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:45.708983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e520c-ec28-4a87-ade5-ae5a25c94c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:45.713422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:45.791052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e520c-ec28-4a87-ade5-ae5a25c94c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:45.792583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e520c-ec28-4a87-ade5-ae5a25c94c9b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:45.905108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 436/868] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:34:45.915774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:45.978947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.028505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439c9e-e984-4504-a15c-84eb3f6650e3 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.028791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439c9e-e984-4504-a15c-84eb3f6650e3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.029073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439c9e-e984-4504-a15c-84eb3f6650e3 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.030817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 437/869] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:46.035544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e768e-9cc6-4ad3-9b6b-b76d2f46d0a7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.036118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f64c7-1601-4015-a488-d3060c7491da None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.036405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f64c7-1601-4015-a488-d3060c7491da None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.036683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f64c7-1601-4015-a488-d3060c7491da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.058262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c52f64c7-1601-4015-a488-d3060c7491da None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:46.060271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c52f64c7-1601-4015-a488-d3060c7491da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:46.079581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817598c4-7313-47fc-a77d-32145e3da78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.080708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817598c4-7313-47fc-a77d-32145e3da78c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.081220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817598c4-7313-47fc-a77d-32145e3da78c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.081710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817598c4-7313-47fc-a77d-32145e3da78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.096811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817598c4-7313-47fc-a77d-32145e3da78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.098290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817598c4-7313-47fc-a77d-32145e3da78c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.101311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-817598c4-7313-47fc-a77d-32145e3da78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:46.120003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.124040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 433/870] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7288-055f-4a97-a482-18be15f52c72 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7288-055f-4a97-a482-18be15f52c72 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7288-055f-4a97-a482-18be15f52c72 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.125244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 434/871] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:46.130813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c7288-055f-4a97-a482-18be15f52c72 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.152596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 438/872] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:46.154103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f04f2-5e81-45b9-83a2-ca0479c35a7b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.154544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f04f2-5e81-45b9-83a2-ca0479c35a7b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.154974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f04f2-5e81-45b9-83a2-ca0479c35a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.176621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-5d4f04f2-5e81-45b9-83a2-ca0479c35a7b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:46.178097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5d4f04f2-5e81-45b9-83a2-ca0479c35a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:46.259536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 439/873] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:46.269441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c7288-055f-4a97-a482-18be15f52c72 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.280771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.308780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.309401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.309687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.310897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.311602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.311917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.313417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.326363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 435/874] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.331516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f04f2-5e81-45b9-83a2-ca0479c35a7b None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.440408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.447682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f04f2-5e81-45b9-83a2-ca0479c35a7b None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.448922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.485262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.485965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.486167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.486439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.496671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.498134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:46.510961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.512208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:46.513097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 440/875] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:46.518698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.573909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a092634-303b-411b-8ca2-b226fd8cdf57 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.613254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.613910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.614193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.614483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.615080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.616521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:46.628280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:46.629331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:46.630179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 436/876] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:46.631186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.645542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9825b13-67d9-4da1-a3de-d82cd455ae61 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.670091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.684526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.685138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.685414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.685684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.686381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.686684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.688161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.705602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 441/877] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:46.705602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.728585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:46.769102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52eac5-4432-47f8-a238-54e4534796d8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.809935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.810582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.810867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.811151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.811844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.813229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.827500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c872e2-9628-4938-9c9d-e5701f161d8c None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:46.866391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:46.866996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:46.867277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:46.868116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:46.868763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:46.869075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:46.870443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:46.875159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 442/878] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:46.878433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.899407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 437/879] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:34:46 2022] POST /identity/v3/services => generated 269 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:46.899407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:46.988109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.010767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:47.014553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda75ae-9bfa-497d-a5f7-e6c131c288d7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.029326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dac4f-9755-41db-93a0-ee6be219772f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:47.058241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b973d-1279-44b0-b138-d25bef9512e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.059156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b973d-1279-44b0-b138-d25bef9512e9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.059469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b973d-1279-44b0-b138-d25bef9512e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.059748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b973d-1279-44b0-b138-d25bef9512e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.060507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b973d-1279-44b0-b138-d25bef9512e9 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=75c6915ce17943a4b9c6c5f4a166a22c) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:47.060804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b973d-1279-44b0-b138-d25bef9512e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.062295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b973d-1279-44b0-b138-d25bef9512e9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.069790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 443/880] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/role_assignments?user.id=75c6915ce17943a4b9c6c5f4a166a22c&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:47.075281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefce05d-bc77-4272-9dbe-f9240321716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:47.076446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce05d-bc77-4272-9dbe-f9240321716f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.076788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce05d-bc77-4272-9dbe-f9240321716f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.077130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce05d-bc77-4272-9dbe-f9240321716f None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.077859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefce05d-bc77-4272-9dbe-f9240321716f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:47.078230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefce05d-bc77-4272-9dbe-f9240321716f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:47.079825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefce05d-bc77-4272-9dbe-f9240321716f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:47.085611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 438/881] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:47.605998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc67540-d331-4f0a-9714-5312757e866a None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.606251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc67540-d331-4f0a-9714-5312757e866a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.606751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc67540-d331-4f0a-9714-5312757e866a None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.608514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 444/882] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:47.614258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45173-1540-4720-8aa9-11846e11aef3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:47.614549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45173-1540-4720-8aa9-11846e11aef3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:47.614830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45173-1540-4720-8aa9-11846e11aef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:47.634602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-53c45173-1540-4720-8aa9-11846e11aef3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:47.635857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-53c45173-1540-4720-8aa9-11846e11aef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:47.714405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 439/883] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:47.987961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc67540-d331-4f0a-9714-5312757e866a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.105431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc67540-d331-4f0a-9714-5312757e866a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.144422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.145057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.145336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.145609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.146198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.147742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:48.157690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:48.158683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:48.159533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 445/884] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:48.164700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c45173-1540-4720-8aa9-11846e11aef3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.255082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:48.275811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c45173-1540-4720-8aa9-11846e11aef3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.312697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.313319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.313622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.313943 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.314522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:48.314829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.316231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.322296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 440/885] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:48.327942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.340045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:48.451667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ed9ab-032a-4839-92c2-79b1ba2642a1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.489062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.489679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.489963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.490239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.490883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:48.491189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.493214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.498755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 446/886] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:48.504549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.613019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc385a-f3c1-43a6-8b8b-fccd446b9732 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.650132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd03147-b5eb-47d1-b0f8-37c8b9fa8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.650799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03147-b5eb-47d1-b0f8-37c8b9fa8293 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.651089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03147-b5eb-47d1-b0f8-37c8b9fa8293 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.651392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03147-b5eb-47d1-b0f8-37c8b9fa8293 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.652117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03147-b5eb-47d1-b0f8-37c8b9fa8293 None admin] RBAC: Adding query filter params (interface=public, service_id=7502571b186e47e88da8eb37c762cf3c, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:48.652575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03147-b5eb-47d1-b0f8-37c8b9fa8293 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.653944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03147-b5eb-47d1-b0f8-37c8b9fa8293 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.659788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 441/887] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:34:48 2022] GET /identity/v3/endpoints?service_id=7502571b186e47e88da8eb37c762cf3c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:48.665352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:48.741833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:48.773590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572e841-4ce6-4e5e-860e-99a395e19dc6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:48.816118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080233a7-d1b3-4098-bd33-18d46bbf92e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:48.816729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080233a7-d1b3-4098-bd33-18d46bbf92e1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.817013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080233a7-d1b3-4098-bd33-18d46bbf92e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.817289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080233a7-d1b3-4098-bd33-18d46bbf92e1 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.817960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080233a7-d1b3-4098-bd33-18d46bbf92e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:48.819411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080233a7-d1b3-4098-bd33-18d46bbf92e1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:48.825527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 447/888] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:34:48 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:34:48.981378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1472-1139-486c-aa64-72802df5c0c4 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.981688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1472-1139-486c-aa64-72802df5c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.981855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1472-1139-486c-aa64-72802df5c0c4 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:48.983509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 442/889] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:48.988744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d89ec1-b1e6-45e2-8880-e87e9eedd1ee None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:48.989262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d89ec1-b1e6-45e2-8880-e87e9eedd1ee None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:48.989430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d89ec1-b1e6-45e2-8880-e87e9eedd1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.008513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-10d89ec1-b1e6-45e2-8880-e87e9eedd1ee None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:49.009698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-10d89ec1-b1e6-45e2-8880-e87e9eedd1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:49.097092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 448/890] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:49.133003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ba55f-f1e3-4f91-8abb-f3eedac16880 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.133367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ba55f-f1e3-4f91-8abb-f3eedac16880 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.133594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ba55f-f1e3-4f91-8abb-f3eedac16880 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.135286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 443/891] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:49.142202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1571c97-2c7a-4b9e-ae49-959c5cf2b73c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.142517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1571c97-2c7a-4b9e-ae49-959c5cf2b73c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.142751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1571c97-2c7a-4b9e-ae49-959c5cf2b73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.162017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d1571c97-2c7a-4b9e-ae49-959c5cf2b73c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:49.163236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d1571c97-2c7a-4b9e-ae49-959c5cf2b73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:49.226492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:49.234882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 449/892] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:49.264412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6151c3-e27e-4ae4-b9a4-3436d07d2b55 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.264982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6151c3-e27e-4ae4-b9a4-3436d07d2b55 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.264982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6151c3-e27e-4ae4-b9a4-3436d07d2b55 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.266568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 444/893] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:49.271923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5704-96f7-449e-826f-61d362432246 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.272208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5704-96f7-449e-826f-61d362432246 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.272480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5704-96f7-449e-826f-61d362432246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.291605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0aaa5704-96f7-449e-826f-61d362432246 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:49.293036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0aaa5704-96f7-449e-826f-61d362432246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:49.368378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 450/894] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:49.394019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6151c3-e27e-4ae4-b9a4-3436d07d2b55 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.407005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:49.524380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa5704-96f7-449e-826f-61d362432246 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.528389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6151c3-e27e-4ae4-b9a4-3436d07d2b55 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:49.576805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:49.577537 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.577887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.578207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.578808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:49.580215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:49.589538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:49.590579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:49.591937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 445/895] 10.222.0.62 () {56 vars in 1132 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:49.596628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.660305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa5704-96f7-449e-826f-61d362432246 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:49.689834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:49.691087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:49.700138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:49.700859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.701039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.701310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.701967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:49.703413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:49.715166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c521-e67e-498b-9174-0599db0ed4c2 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:49.749722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:49.750308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.750587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.750857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.751516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:49.751821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:49.753171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:49.757748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 446/896] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:49.760803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.796987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 451/897] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:34:49 2022] POST /identity/v3/services => generated 241 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:49.798164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:49.902846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb022e52-508e-4545-a4f3-4efa7417b3a7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:49.946374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a765a5-efc0-4529-835c-5e806aabe819 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:49.960195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:49.962031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:49.962497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:49.963222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:49.973133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:49.980419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:49.985750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:49.986809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:49.990089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 447/898] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:49.995509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.001419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.002095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.002379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.002656 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.003304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:50.003669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.005121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.013445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 452/899] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:50.020069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.075698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.108593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf96a7-5d21-409b-8fd3-50f7c864973c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.133723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0667b-5a52-4f65-abc6-383fc87ece05 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.145133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.146139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.146633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.147116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.148115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:50.149237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.150936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.165786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 448/900] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Aug 18 20:34:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:50.167700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.170975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.171704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.171988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.172266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.173500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] RBAC: Adding query filter params (interface=public, service_id=d0dd94063f7246ad925fb5eb1c143dbb, region_id=RegionOne) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:50.173500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.174897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.183338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 453/901] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/endpoints?service_id=d0dd94063f7246ad925fb5eb1c143dbb&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:50.189284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.235466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.279991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b00b-7e89-4c37-a92d-6ce2d8a5e27e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.299647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9aff0-be35-451e-91f4-3833c6744796 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.313372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.319666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.321576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.322094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.322579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.338265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.339785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.340404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.340690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.340809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.340978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.341597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.342974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.351454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 454/902] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:50.365781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:50.367059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:50.368613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:50.368613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:50.368613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:50.370541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 449/903] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:50.376996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.505023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2cc1-3459-4fa7-861d-18ab87991cce None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.543840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.544462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.544732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.544999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.545649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:50.545939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.547353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.560884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 455/904] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:50.565422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.676826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8eb6d-1d30-42a8-804b-89b5b2ab038b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.690838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.713865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d10a7-18bd-4c7b-bcb0-5a360e874225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.714574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d10a7-18bd-4c7b-bcb0-5a360e874225 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.714864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d10a7-18bd-4c7b-bcb0-5a360e874225 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.715145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d10a7-18bd-4c7b-bcb0-5a360e874225 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.724041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d10a7-18bd-4c7b-bcb0-5a360e874225 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.725566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d10a7-18bd-4c7b-bcb0-5a360e874225 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-030d10a7-18bd-4c7b-bcb0-5a360e874225 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:50.737892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:50.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:50.740119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:50.742178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 450/905] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:50.747581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.786826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:50.844096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7fc83-c2af-40a4-813c-b08e3d337aa7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.844451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7fc83-c2af-40a4-813c-b08e3d337aa7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.846242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7fc83-c2af-40a4-813c-b08e3d337aa7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.846242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 451/906] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:50.853004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54025-ba44-419b-87f5-5b59d1df59a8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.853372 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54025-ba44-419b-87f5-5b59d1df59a8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.853608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54025-ba44-419b-87f5-5b59d1df59a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.871276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adad6b-bb4d-42e2-8ffa-d0beee74366e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:50.883508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-94c54025-ba44-419b-87f5-5b59d1df59a8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:50.886737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-94c54025-ba44-419b-87f5-5b59d1df59a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:50.912825 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:50.913440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:50.913717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:50.913988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:50.915394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:50.915700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:50.917221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:50.937311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 456/907] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:50.943572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:50.987413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 452/908] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:51.052725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.063256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94c844-70ae-41c0-b8bc-4129d27d39be None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.102447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.103352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.103817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.104245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.178158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.179917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.276133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c54025-ba44-419b-87f5-5b59d1df59a8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.277964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.292687 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 457/909] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:34:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:34:51.295283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.422748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c54025-ba44-419b-87f5-5b59d1df59a8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.425795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.443820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482aac4-5a67-447b-b1f3-01bc08e4eab9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.471789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.472433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.472703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.472983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.473692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.474957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.485012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.486095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:51.486927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 453/910] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:51.494465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.497731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.498618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.499142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.499694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.510965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.513050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:51.529859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.530898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:51.531904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:51.531904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:51.531904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:51.538475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 458/911] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:51.540692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.588983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.623084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688382-c587-4e87-9a0d-2f309ae61f38 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.655765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b820fa8-af79-434e-a24b-91779e578ba1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.671518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.672586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.672871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.673145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.673783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:51.674346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.676007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.687249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 454/912] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:51.688175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.699617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.700521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.701013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.701482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.702333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:51.702843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.704597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.722698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 459/913] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:51.724350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.724573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.815483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a535-d3b6-46df-a360-1dd2e449ef89 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.830920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab49953-dc39-4eb5-87af-35e435ab4f81 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:51.833458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.861196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1915fc3-ad16-4f74-bb89-2c535ecfdaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.861921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1915fc3-ad16-4f74-bb89-2c535ecfdaa1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.862437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1915fc3-ad16-4f74-bb89-2c535ecfdaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.862716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1915fc3-ad16-4f74-bb89-2c535ecfdaa1 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.863398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1915fc3-ad16-4f74-bb89-2c535ecfdaa1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:51.863714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1915fc3-ad16-4f74-bb89-2c535ecfdaa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.865408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1915fc3-ad16-4f74-bb89-2c535ecfdaa1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.874547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6760c85-7c43-4bb4-b527-c418fe7c6dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:51.875192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760c85-7c43-4bb4-b527-c418fe7c6dd2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.875507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760c85-7c43-4bb4-b527-c418fe7c6dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.875782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760c85-7c43-4bb4-b527-c418fe7c6dd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.876352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 455/914] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:51.877614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed93b3-b2a3-4037-bf9a-34934793df78 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.877898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed93b3-b2a3-4037-bf9a-34934793df78 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.878171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed93b3-b2a3-4037-bf9a-34934793df78 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.883515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 456/915] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:51.883515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed93b3-b2a3-4037-bf9a-34934793df78 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:51.888742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6760c85-7c43-4bb4-b527-c418fe7c6dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:51.890206 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6760c85-7c43-4bb4-b527-c418fe7c6dd2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-c6760c85-7c43-4bb4-b527-c418fe7c6dd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:51.903915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:51.905096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:51.906037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 460/916] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:51.906538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ab9f-059c-4f35-a740-60e55742cb32 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:51.906739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ab9f-059c-4f35-a740-60e55742cb32 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:51.907008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ab9f-059c-4f35-a740-60e55742cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:51.924911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-df94ab9f-059c-4f35-a740-60e55742cb32 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:51.926180 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-df94ab9f-059c-4f35-a740-60e55742cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:51.989865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:51.997553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed93b3-b2a3-4037-bf9a-34934793df78 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.007404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 461/917] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:52.007404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94ab9f-059c-4f35-a740-60e55742cb32 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.043183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.043821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.044100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.044373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.045035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.046396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.121577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.128673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94ab9f-059c-4f35-a740-60e55742cb32 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.147907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 457/918] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:34:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:34:52.185665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.186672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.187161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.187668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.188662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.189284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.191055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.206762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 462/919] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.213263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.277170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.359995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4b5a3-0d99-482b-96d7-a537ddc1c2f6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.404003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.404544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.404835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.405094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.405830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] RBAC: Adding query filter params (role.id=2569e4466fb341139e7126223b053b75, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=75c6915ce17943a4b9c6c5f4a166a22c) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.406146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.407632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.415001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 458/920] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/role_assignments?user.id=75c6915ce17943a4b9c6c5f4a166a22c&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=2569e4466fb341139e7126223b053b75 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.415182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7500e57-4f7f-4dbb-9732-c7e5e600a980 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.453155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958072dc-3e40-45b7-947c-f59a85ff850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.453813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958072dc-3e40-45b7-947c-f59a85ff850e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.454095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958072dc-3e40-45b7-947c-f59a85ff850e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.454367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958072dc-3e40-45b7-947c-f59a85ff850e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.454972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958072dc-3e40-45b7-947c-f59a85ff850e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.456396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958072dc-3e40-45b7-947c-f59a85ff850e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-958072dc-3e40-45b7-947c-f59a85ff850e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:52.466655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:52.467804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:52.468661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 463/921] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:52.474510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.500771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.580104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f57cf8-dac4-4b70-b8cf-764c05fed74e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.580386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f57cf8-dac4-4b70-b8cf-764c05fed74e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.580690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f57cf8-dac4-4b70-b8cf-764c05fed74e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.582964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 464/922] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:52.589685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55a63a-bb82-4c04-bd8f-c5ad7b09df67 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.589958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55a63a-bb82-4c04-bd8f-c5ad7b09df67 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.590277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55a63a-bb82-4c04-bd8f-c5ad7b09df67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.606461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67ebe8-e113-4d43-86d6-2e0284fb1bf7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.616768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6a55a63a-bb82-4c04-bd8f-c5ad7b09df67 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:52.619701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6a55a63a-bb82-4c04-bd8f-c5ad7b09df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:52.634158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.651625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.652245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.652524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.652799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.653442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.653814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.655400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.660753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 459/923] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:52.666155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.737872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 465/924] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:52.815797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:52.838178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c04ee-5817-4a2f-aa64-1224961e3a69 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:52.873747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:52.874352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:52.874630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:52.874901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:52.875586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:52.875894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:52.877247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:52.883576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 460/925] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:52.889752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55a63a-bb82-4c04-bd8f-c5ad7b09df67 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:52.995982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55a63a-bb82-4c04-bd8f-c5ad7b09df67 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.035188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.035821 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.036101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.036372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.037070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] RBAC: Adding query filter params (interface=public, service_id=0bb5e20407f9463a8eb051c2b3a1028b, region_id=RegionOne) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.037382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.038804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.044385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 466/926] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:34:52 2022] GET /identity/v3/endpoints?service_id=0bb5e20407f9463a8eb051c2b3a1028b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.049800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.068591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.080502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.168921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae7ad-f76c-4d21-9ae5-eb69b1db7597 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.191899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413076a-11d2-41e6-8ab4-9b645190de80 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.213569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.214282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.214552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.214831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.216038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.217718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.227398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 461/927] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:34:53.237006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.237954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.238395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.238827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.239632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.241233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:53.252216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:53.253451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:34:53.254351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:53.256850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 467/928] 10.222.0.62 () {56 vars in 1132 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:53.266794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.277243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.391177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38686119-8256-41af-98e3-64c2e7d47f13 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.429479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.430665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.431394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.431394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.431887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.432193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.433583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.439658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 462/929] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.445024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.520188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.553905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4568e6-268b-4309-8a37-8dffc34815e6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.590178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59631eba-41b4-407a-813e-c9ed5a70bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.590787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631eba-41b4-407a-813e-c9ed5a70bf41 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.591064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631eba-41b4-407a-813e-c9ed5a70bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.591339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631eba-41b4-407a-813e-c9ed5a70bf41 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.591996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59631eba-41b4-407a-813e-c9ed5a70bf41 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:53.592463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59631eba-41b4-407a-813e-c9ed5a70bf41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.593837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59631eba-41b4-407a-813e-c9ed5a70bf41 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.599288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 468/930] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:53.605556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:53.695705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:53.728739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3621217-16ab-4887-96cf-b042d9202047 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:53.763068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dc2fa-ef9e-414c-8932-20bebec16097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:53.763702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc2fa-ef9e-414c-8932-20bebec16097 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:53.763980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc2fa-ef9e-414c-8932-20bebec16097 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:53.764248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc2fa-ef9e-414c-8932-20bebec16097 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:53.764925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dc2fa-ef9e-414c-8932-20bebec16097 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:53.766372 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dc2fa-ef9e-414c-8932-20bebec16097 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:53.881903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 463/931] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:34:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:34:54.326317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420ae19-56b0-4d8f-9c6f-90309d44b275 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.327119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420ae19-56b0-4d8f-9c6f-90309d44b275 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.327119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420ae19-56b0-4d8f-9c6f-90309d44b275 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.328782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 469/932] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:54.339330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4604-6503-4e1b-8ee4-8a820faedbd8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.339744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4604-6503-4e1b-8ee4-8a820faedbd8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.340125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4604-6503-4e1b-8ee4-8a820faedbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.367138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1f3d4604-6503-4e1b-8ee4-8a820faedbd8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:54.369355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1f3d4604-6503-4e1b-8ee4-8a820faedbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:54.449807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 464/933] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:54.490034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd9972-3149-4d7e-bcee-a3eda1446731 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.490353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd9972-3149-4d7e-bcee-a3eda1446731 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.490575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd9972-3149-4d7e-bcee-a3eda1446731 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.492712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 470/934] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:54.498215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718e362-f7a8-41e0-9833-3e65b57835f1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.498769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718e362-f7a8-41e0-9833-3e65b57835f1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.499255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718e362-f7a8-41e0-9833-3e65b57835f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.521094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9718e362-f7a8-41e0-9833-3e65b57835f1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:54.522297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9718e362-f7a8-41e0-9833-3e65b57835f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:54.575238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.596587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 465/935] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:54.731565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd9972-3149-4d7e-bcee-a3eda1446731 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.850178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd9972-3149-4d7e-bcee-a3eda1446731 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:54.886475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718e362-f7a8-41e0-9833-3e65b57835f1 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:54.887930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:54.888555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:54.888907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:54.889189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:54.889843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:54.892509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:54.895265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING keystone.server.flask.common [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 20:34:54.900560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:54.957353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.sql.core [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:34:54.957353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:34:54.957353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [parameters: {'id': '1d97eee21ab34ee9956ffef795e465d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:34:54.957353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88548) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1d97eee21ab34ee9956ffef795e465d8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1d97eee21ab34ee9956ffef795e465d8. Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:54.976374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 20:34:54.977792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application yield resource Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise self.value Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application session.commit() Aug 18 20:34:54.978953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:34:54.980384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:34:54.982344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:54.983534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [parameters: {'id': '1d97eee21ab34ee9956ffef795e465d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.990000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:54.990811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1d97eee21ab34ee9956ffef795e465d8. Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 471/936] 10.222.0.62 () {60 vars in 1140 bytes} [Thu Aug 18 20:34:54 2022] POST /identity/v3/projects => generated 262 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:54.991748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.024391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718e362-f7a8-41e0-9833-3e65b57835f1 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.066069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006734e-6627-4220-8886-833091995fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.066628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006734e-6627-4220-8886-833091995fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.066911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006734e-6627-4220-8886-833091995fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.067190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006734e-6627-4220-8886-833091995fd4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.080821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006734e-6627-4220-8886-833091995fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d006734e-6627-4220-8886-833091995fd4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:34:55.087803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.088765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:55.089598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 466/937] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:55.095556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006734e-6627-4220-8886-833091995fd4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.115942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ebd2e-18bc-4564-8cf9-5a61181efdb8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.153273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.155267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.156208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.156928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.157285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.167690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.169963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:55.185311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.186281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:55.187524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 472/938] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:55.193903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.218835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006734e-6627-4220-8886-833091995fd4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.250568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.265183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.266295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.266752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.267187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.268145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.268801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.271352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.285438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 467/939] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.291616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.308842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fc64e-d19d-433c-98c8-24000dc12c13 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.352098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b297e-7160-4370-871d-272fd06dd4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.352905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b297e-7160-4370-871d-272fd06dd4b0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.353186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b297e-7160-4370-871d-272fd06dd4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.353459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b297e-7160-4370-871d-272fd06dd4b0 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.354458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b297e-7160-4370-871d-272fd06dd4b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.354801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b297e-7160-4370-871d-272fd06dd4b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.357110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b297e-7160-4370-871d-272fd06dd4b0 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.387557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 473/940] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.391018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080acd-77da-4b67-8d92-cff57a6459c1 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.391346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080acd-77da-4b67-8d92-cff57a6459c1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.393230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080acd-77da-4b67-8d92-cff57a6459c1 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.398826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 474/941] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:55.401086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bbffb-a8e1-4be3-b1f5-d8086dc4b384 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.401360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bbffb-a8e1-4be3-b1f5-d8086dc4b384 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.401641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bbffb-a8e1-4be3-b1f5-d8086dc4b384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.426524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726603-8e71-4c6f-8004-2a7070a22ca4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.426912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ff7bbffb-a8e1-4be3-b1f5-d8086dc4b384 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:55.428562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ff7bbffb-a8e1-4be3-b1f5-d8086dc4b384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:55.431843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.482563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.483642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.484165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.484700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.502346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.505227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.527389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 475/942] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:55.529135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.530057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:55.530974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:55.530974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:55.530974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:55.530974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 468/943] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:55.536882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bbffb-a8e1-4be3-b1f5-d8086dc4b384 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.588567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.651782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bbffb-a8e1-4be3-b1f5-d8086dc4b384 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.693717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.694336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.694618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.694893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.695620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:55.695930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.697306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.710063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 476/944] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:55.716030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.823099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2fff3-1453-47ff-9e33-04380ed1a42c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.830259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.870584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.871708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.872201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.872883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.881723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.883711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:55.896889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:55.898296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:34:55.899833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:55.902328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 469/945] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:34:55.908647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:55.939788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.951619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a4f3-e901-4abb-8fd4-7164eb79c389 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:55.953436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:55.992987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0db3b5-5b43-493c-b4ba-ce4fbd3b7933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:55.994036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0db3b5-5b43-493c-b4ba-ce4fbd3b7933 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:55.994469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0db3b5-5b43-493c-b4ba-ce4fbd3b7933 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:55.994893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0db3b5-5b43-493c-b4ba-ce4fbd3b7933 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:55.995782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0db3b5-5b43-493c-b4ba-ce4fbd3b7933 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:55.997383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0db3b5-5b43-493c-b4ba-ce4fbd3b7933 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-1e0db3b5-5b43-493c-b4ba-ce4fbd3b7933 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:56.007727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:56.008751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:56.009635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 477/946] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:56.011491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba101-e7b2-42ca-a6e5-11affdcb9a20 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.011491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba101-e7b2-42ca-a6e5-11affdcb9a20 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.011491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba101-e7b2-42ca-a6e5-11affdcb9a20 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.016660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 478/947] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:56.017519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ba101-e7b2-42ca-a6e5-11affdcb9a20 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.043829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b28a-28c8-4ac9-a035-7240a4871fa4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.091347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1c32c-2a8e-4c19-a3e8-e49e6dfad5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.092100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1c32c-2a8e-4c19-a3e8-e49e6dfad5f2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.092378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1c32c-2a8e-4c19-a3e8-e49e6dfad5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.092665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1c32c-2a8e-4c19-a3e8-e49e6dfad5f2 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.093391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1c32c-2a8e-4c19-a3e8-e49e6dfad5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.093764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1c32c-2a8e-4c19-a3e8-e49e6dfad5f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.095199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1c32c-2a8e-4c19-a3e8-e49e6dfad5f2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.114149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 470/948] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Aug 18 20:34:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:56.116878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9234d89-6c4c-4d16-9fc0-a4334d1c67fa None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.117444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9234d89-6c4c-4d16-9fc0-a4334d1c67fa None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.117937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9234d89-6c4c-4d16-9fc0-a4334d1c67fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.137185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b9234d89-6c4c-4d16-9fc0-a4334d1c67fa None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:56.138516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b9234d89-6c4c-4d16-9fc0-a4334d1c67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:56.138628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ba101-e7b2-42ca-a6e5-11affdcb9a20 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.182790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.183320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.183629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.183911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.184698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.185031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.186522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.197074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 479/949] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:56.197074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.216639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 471/950] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:56.217502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9234d89-6c4c-4d16-9fc0-a4334d1c67fa None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.225570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.238208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.333885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4cb1e-0b51-4981-a123-a4cb0a8de92d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.338388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9234d89-6c4c-4d16-9fc0-a4334d1c67fa None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.381572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.383415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.383891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.384375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.385850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.386569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.387207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.387623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.388582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.388828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.390330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.401438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 472/951] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:56.402968 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.403415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.404540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:34:56.420942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:56.421939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:34:56.423462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:34:56.423462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:34:56.423462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:56.426993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 480/952] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:56.428048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.498160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.521367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.536227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2697a2-f329-4e44-b496-0d3164ab0dd4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.540116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9f9e-6bcc-4a17-a315-aad82e38f0f2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.576165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.576781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.577063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.577335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.578013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.580405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.580537 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.580631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.580631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.580631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.580955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:56.581266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.582620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.595695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 481/953] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:56.596528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.655997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 473/954] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:34:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:34:56.665140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.744289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed094-f7a9-4e40-94ae-658c4765af37 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.813900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.814468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.814906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.815183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.816143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.817974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.826501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d725-a3bc-42ac-a590-8e0b0096203f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:56.831626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:56.832770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:56.834231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 482/955] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:56.851393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.851393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.869742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:56.887531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:56.888343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:56.888623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:56.888891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:56.898977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:56.900416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:34:56.912582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:56.913550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:56.915136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 474/956] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:56.920956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:56.990237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b73f-6921-43f2-abd2-a0c56363a2ae None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:57.038549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:57.040581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.041354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.041850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.043351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:57.044152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:57.045781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:57.045979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e87ea-1d9e-4a5f-95d9-61b3670f8c87 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:57.058177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 483/957] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:57.061462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:57.088587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:57.089180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.089465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.089739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.090493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:57.090979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:57.092324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:57.111995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 475/958] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:57.112441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:57.159998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:57.175556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:57.210604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b323a1e-6104-4640-867b-9f845359f2cc None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:57.236386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f03e-2321-4324-bf78-129ff0050e86 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:57.266497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d3505-7731-4611-b935-551425a5f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:57.267541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3505-7731-4611-b935-551425a5f175 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.268524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3505-7731-4611-b935-551425a5f175 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.269015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3505-7731-4611-b935-551425a5f175 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.269870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d3505-7731-4611-b935-551425a5f175 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:57.271008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d3505-7731-4611-b935-551425a5f175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:57.273453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d3505-7731-4611-b935-551425a5f175 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:57.287839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 484/959] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:34:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:57.294355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071415-b294-41d2-83d2-7489f2d75787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:57.295049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071415-b294-41d2-83d2-7489f2d75787 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.295327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071415-b294-41d2-83d2-7489f2d75787 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.295636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071415-b294-41d2-83d2-7489f2d75787 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/75c6915ce17943a4b9c6c5f4a166a22c/roles/2569e4466fb341139e7126223b053b75` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.298002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73071415-b294-41d2-83d2-7489f2d75787 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=75c6915ce17943a4b9c6c5f4a166a22c, role_id=2569e4466fb341139e7126223b053b75)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:57.299541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73071415-b294-41d2-83d2-7489f2d75787 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:57.384159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 476/960] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:34:57 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/75c6915ce17943a4b9c6c5f4a166a22c/roles/2569e4466fb341139e7126223b053b75 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:34:57.555713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af5e8-5582-480a-85c9-af09cc741ff0 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.556272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af5e8-5582-480a-85c9-af09cc741ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.556272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af5e8-5582-480a-85c9-af09cc741ff0 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.557915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 485/961] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:57.563574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818649c-eb63-4cde-b2bf-c5105384100f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:57.563864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818649c-eb63-4cde-b2bf-c5105384100f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:57.564143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818649c-eb63-4cde-b2bf-c5105384100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:57.583676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5818649c-eb63-4cde-b2bf-c5105384100f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:57.584889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5818649c-eb63-4cde-b2bf-c5105384100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:57.660993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 477/962] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:57.938300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19af5e8-5582-480a-85c9-af09cc741ff0 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.073127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19af5e8-5582-480a-85c9-af09cc741ff0 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.112703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.119252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.120105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.120540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.120965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.121766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.123427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.191343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.sql.core [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:34:58.191343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:34:58.191343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [parameters: {'user_id': '4434072a2dfe48c48c44b7a5abe4377e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:34:58.191343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88548) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:58.199628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:58.202324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application yield resource Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise self.value Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application session.commit() Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:34:58.203607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:34:58.204775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:34:58.206097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application result.read() Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:34:58.207222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [parameters: {'user_id': '4434072a2dfe48c48c44b7a5abe4377e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:58.208309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 20:34:58.209240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 20:34:58.210616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 20:34:58.210616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 20:34:58.210616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:34:58.210616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:34:58.210616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:34:58.210616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:34:58.212199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818649c-eb63-4cde-b2bf-c5105384100f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.212758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 486/963] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Aug 18 20:34:57 2022] POST /identity/v3/users => generated 160 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:58.243257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.313869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818649c-eb63-4cde-b2bf-c5105384100f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.350193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0836a-9daf-477e-a6ab-96f041c6fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.350842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0836a-9daf-477e-a6ab-96f041c6fac1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.352082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0836a-9daf-477e-a6ab-96f041c6fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.352082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0836a-9daf-477e-a6ab-96f041c6fac1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.359808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0836a-9daf-477e-a6ab-96f041c6fac1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.361274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0836a-9daf-477e-a6ab-96f041c6fac1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-99a0836a-9daf-477e-a6ab-96f041c6fac1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:34:58.373349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:58.375296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:58.376497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 478/964] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:58.380529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:58.497470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20714857-dc33-4f2c-81fd-47f0dbb76dec None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:58.533809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435f0b2-90c8-4164-8946-0a3bb345c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:58.534441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435f0b2-90c8-4164-8946-0a3bb345c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.534723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435f0b2-90c8-4164-8946-0a3bb345c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.535052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435f0b2-90c8-4164-8946-0a3bb345c0b5 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.535836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435f0b2-90c8-4164-8946-0a3bb345c0b5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:58.536139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435f0b2-90c8-4164-8946-0a3bb345c0b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:58.537879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435f0b2-90c8-4164-8946-0a3bb345c0b5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:58.581444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 487/965] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Aug 18 20:34:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:58.795664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b375a6-aac6-4475-93c3-2d5badfa19c8 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.796044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b375a6-aac6-4475-93c3-2d5badfa19c8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.796243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b375a6-aac6-4475-93c3-2d5badfa19c8 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.797700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 479/966] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:58.805189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902ae9-fc97-44f6-b5bc-09a7409daeff None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:58.805469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902ae9-fc97-44f6-b5bc-09a7409daeff None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:58.805742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902ae9-fc97-44f6-b5bc-09a7409daeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:58.834858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-99902ae9-fc97-44f6-b5bc-09a7409daeff None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:58.837152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-99902ae9-fc97-44f6-b5bc-09a7409daeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:58.907681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:58.930775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 488/967] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:59.202043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b375a6-aac6-4475-93c3-2d5badfa19c8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.301481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.310722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b375a6-aac6-4475-93c3-2d5badfa19c8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.357503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51dbc-ace7-43b3-b5cc-257ae88e9e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.358555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51dbc-ace7-43b3-b5cc-257ae88e9e2b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.358838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51dbc-ace7-43b3-b5cc-257ae88e9e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.359107 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51dbc-ace7-43b3-b5cc-257ae88e9e2b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.359765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc51dbc-ace7-43b3-b5cc-257ae88e9e2b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.361677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc51dbc-ace7-43b3-b5cc-257ae88e9e2b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-3cc51dbc-ace7-43b3-b5cc-257ae88e9e2b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:34:59.372724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:34:59.373758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:34:59.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:34:59.376021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 480/968] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:34:59.379836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99902ae9-fc97-44f6-b5bc-09a7409daeff None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.388238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb8953-74c2-43f8-84c5-ddc9d4bce674 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.388531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb8953-74c2-43f8-84c5-ddc9d4bce674 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.388809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb8953-74c2-43f8-84c5-ddc9d4bce674 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.390352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 481/969] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:34:59.395625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a336ea-6591-4873-a6fa-01bcb4f57ef0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.396098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a336ea-6591-4873-a6fa-01bcb4f57ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.396382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a336ea-6591-4873-a6fa-01bcb4f57ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.415552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-98a336ea-6591-4873-a6fa-01bcb4f57ef0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:59.416755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-98a336ea-6591-4873-a6fa-01bcb4f57ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:59.491472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99902ae9-fc97-44f6-b5bc-09a7409daeff None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.499637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 482/970] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:34:59.500910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43796-d03c-42e4-b0da-25447526106b None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.501194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43796-d03c-42e4-b0da-25447526106b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.501465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43796-d03c-42e4-b0da-25447526106b None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.502699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 483/971] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:34:59.508520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc959d5-6d7f-4638-9598-33de664c9066 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.508803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc959d5-6d7f-4638-9598-33de664c9066 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.509077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc959d5-6d7f-4638-9598-33de664c9066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.530431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bcc959d5-6d7f-4638-9598-33de664c9066 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:34:59.531637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bcc959d5-6d7f-4638-9598-33de664c9066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:34:59.539197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.540048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.540335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.540672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.541326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:59.541624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.543003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.548157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 489/972] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:59.553721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.605645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.619393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 484/973] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:34:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:34:59.674492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb459-dafb-4bc0-9f3e-e60de07acff4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.712065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.712667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.714067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.714067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.714067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:59.714350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.715580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.725827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 490/974] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:34:59.727200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc959d5-6d7f-4638-9598-33de664c9066 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.752434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.771982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.846322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc959d5-6d7f-4638-9598-33de664c9066 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.891170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.891997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.892323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.892608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.893341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] RBAC: Adding query filter params (interface=admin, service_id=0bb5e20407f9463a8eb051c2b3a1028b, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:34:59.893749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.895118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.901445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 485/975] 10.222.0.62 () {56 vars in 1249 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/endpoints?service_id=0bb5e20407f9463a8eb051c2b3a1028b&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:34:59.901609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:34:59.905510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493c5e-8881-42fb-95bd-b5f9e7e5c3c6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:34:59.915335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:34:59.943018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:34:59.943715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:34:59.944288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:34:59.946084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:34:59.946735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:34:59.948138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:34:59.987897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.006371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f748c-c342-4c07-8021-85f596f9add8 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.008571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 491/976] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:34:59 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:00.009469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.053455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.054296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.055574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.056286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.072109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:00.078561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:00.079834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:00.080763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 486/977] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Aug 18 20:34:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:00.086218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.151907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767999-cd63-42ff-96f1-8c22c26ed9a2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.197472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.198177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.198460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.198737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.199401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.200892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.206984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519d905-8242-41c4-8d20-08d648e6cacd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.208161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 492/978] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/services => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:35:00.248247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.248933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.249163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.249413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.250098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.250402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.251840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.258988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.267399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 487/979] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:00.273657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.310034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.399024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a5a14-e73a-40df-9cc0-036c189c5e6f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.436093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.436719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.436993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.437262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.448661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.450145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:00.466529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:00.468084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:00.469381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:00.469381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:00.469381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:00.469381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 493/980] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:00.474401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.605661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4f514-adc3-41ef-aa64-9e5231512513 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.649320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.649941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.650219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.650491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.651142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:00.651476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.652841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.669775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 488/981] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:00.670960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.773293 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.794632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88101a93-e99f-4200-b19a-d91523f8e2d9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:00.843443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:00.844496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:00.844985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:00.845458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:00.857579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:00.858990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:00.874534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:00.876207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:00.877437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 494/982] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:00.881644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:00.951683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:00.992575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641631a-df46-46ac-88d6-3405eb3ffc06 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:01.032999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:01.033737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.034024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.034298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.035897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:01.036416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:01.038065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:01.070082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 489/983] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Aug 18 20:35:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:01.071244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:01.183323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cd43-f74e-472e-b9ff-e8de601a2deb None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:01.224766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:01.225454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.225741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.225991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.245020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:01.308716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:01.310881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:01.428788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 495/984] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:01 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:01.430826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:01.548343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6458e-8b3b-4645-a4fa-8d87835eccca None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:01.569094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:01.588505 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:01.589148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.589428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.589698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.601837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:01.603293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:01.618719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:01.619985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:01.620932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:01.620932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:01.620932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:01.621713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 490/985] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:01.625554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:01.680188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:01.742445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f346-c53a-481e-975a-da854e18ce19 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:01.788148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1731b-8a09-458d-bf88-9f969b244d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:01.788797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1731b-8a09-458d-bf88-9f969b244d23 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.789076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1731b-8a09-458d-bf88-9f969b244d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.789348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1731b-8a09-458d-bf88-9f969b244d23 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.790003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1731b-8a09-458d-bf88-9f969b244d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:01.790306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1731b-8a09-458d-bf88-9f969b244d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:01.791707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1731b-8a09-458d-bf88-9f969b244d23 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:01.805331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 496/986] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:01.810630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:01.920739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a4c0-0456-4367-b5b7-f2dac93f0e6d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:01.955620 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:01.956261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.956545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.956820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.963872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:01.965328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:01.976965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:01.977921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:01.978814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:01.981215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e587fe0-ae66-4d59-8f3d-e9c08c439860 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.981507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e587fe0-ae66-4d59-8f3d-e9c08c439860 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.981784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e587fe0-ae66-4d59-8f3d-e9c08c439860 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:01.982882 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 491/987] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:01.983273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 497/988] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:01.983778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:01.988925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7b660-7cf4-46b4-a0f2-5196d743af94 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:01.989233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7b660-7cf4-46b4-a0f2-5196d743af94 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:01.989474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7b660-7cf4-46b4-a0f2-5196d743af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.009262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-86b7b660-7cf4-46b4-a0f2-5196d743af94 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:02.010488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-86b7b660-7cf4-46b4-a0f2-5196d743af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:02.018469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.090415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 498/989] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:02.103374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4f4d-7d88-48b6-a3ce-d690f1e6c179 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.141805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705635b-4543-4f4e-89e7-b5f349aee289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.142424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705635b-4543-4f4e-89e7-b5f349aee289 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.142707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705635b-4543-4f4e-89e7-b5f349aee289 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.142984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705635b-4543-4f4e-89e7-b5f349aee289 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.143725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705635b-4543-4f4e-89e7-b5f349aee289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:02.144036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705635b-4543-4f4e-89e7-b5f349aee289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.145470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705635b-4543-4f4e-89e7-b5f349aee289 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.166521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 492/990] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:02.168479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7b660-7cf4-46b4-a0f2-5196d743af94 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.186080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623940d-314e-4467-9dc6-404e7d65c704 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.186397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623940d-314e-4467-9dc6-404e7d65c704 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.186650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623940d-314e-4467-9dc6-404e7d65c704 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.189030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 493/991] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:02.193854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a116d-ca26-4988-bff0-7a93a06222a7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.194140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a116d-ca26-4988-bff0-7a93a06222a7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.194414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a116d-ca26-4988-bff0-7a93a06222a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.205628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.213943 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7d1a116d-ca26-4988-bff0-7a93a06222a7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:02.215146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7d1a116d-ca26-4988-bff0-7a93a06222a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:02.274385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7b660-7cf4-46b4-a0f2-5196d743af94 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.287525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 494/992] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:02.311461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.312069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.312348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.312621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.313351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] RBAC: Adding query filter params (role.id=2569e4466fb341139e7126223b053b75, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=75c6915ce17943a4b9c6c5f4a166a22c) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:02.313662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.315096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.321170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 499/993] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/role_assignments?user.id=75c6915ce17943a4b9c6c5f4a166a22c&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=2569e4466fb341139e7126223b053b75 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:02.358916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a116d-ca26-4988-bff0-7a93a06222a7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.383382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.467909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a116d-ca26-4988-bff0-7a93a06222a7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.505947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.506597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.506881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.507157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.507928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.509374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:02.518713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:02.519962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:02.520813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 495/994] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:02.527651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.568266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.664558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.664558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f328833-a0a7-40b9-8107-02519684ee4f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.665270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.680705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.682717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.682717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.682717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.682717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:02.683043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.684278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.688696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f10aa7-ff7e-4d10-8334-95eb1a566c77 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.698750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 500/995] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:02.699920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.736873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.737862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.738370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.739068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.739939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.742134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:02.752445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:02.753466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:02.754331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 496/996] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:02.759500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.811401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8f89-28d1-4587-91e1-bc08fefbf93b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.847692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.848307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.848597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.848870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.849501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:02.849808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.851748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.856675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 501/997] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:02.862266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.877755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d0b51-30ae-481c-9380-05622e01e3a7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:02.890559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.922694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:02.922694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:02.922694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:02.922694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:02.923086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:02.923086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:02.923972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:02.929623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 497/998] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:02.935163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:02.952412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:02.983284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c2da-49ba-4029-82ad-6a2f97379757 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.019693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.020295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.020585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.020846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.021606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] RBAC: Adding query filter params (interface=public, service_id=a5318308d0a44755a05afdf6e523553a, region_id=RegionOne) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:03.022616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.023913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.029201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 502/999] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/endpoints?service_id=a5318308d0a44755a05afdf6e523553a&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:03.034735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.057704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cbdaf-2abe-4d61-82cf-3482756a0e04 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.094174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.094774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.095051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.095325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.095983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:03.096282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.097630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.107447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 498/1000] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Aug 18 20:35:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:03.108363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:03.134240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:03.144041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc218fb-b783-4318-8a0a-7035d74a4617 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.187001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa369b2-9dc1-4915-ae07-5a4d0e2245c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.187560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa369b2-9dc1-4915-ae07-5a4d0e2245c8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.187841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa369b2-9dc1-4915-ae07-5a4d0e2245c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.188115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa369b2-9dc1-4915-ae07-5a4d0e2245c8 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.188726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa369b2-9dc1-4915-ae07-5a4d0e2245c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.190094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa369b2-9dc1-4915-ae07-5a4d0e2245c8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.193382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:03.197352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 503/1001] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:03 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:35:03.218918 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aecf1-c6a7-4d04-858e-a36a2ce28eff None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:03.257145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31f167-bf44-4281-9997-a4a1a8240ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:03.258328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31f167-bf44-4281-9997-a4a1a8240ae3 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:03.258608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31f167-bf44-4281-9997-a4a1a8240ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:03.258973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31f167-bf44-4281-9997-a4a1a8240ae3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:03.259806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31f167-bf44-4281-9997-a4a1a8240ae3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:03.261219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31f167-bf44-4281-9997-a4a1a8240ae3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:03.329027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 499/1002] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:04.290255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e128783-8567-44d6-93d6-d94f3880ad99 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.290795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e128783-8567-44d6-93d6-d94f3880ad99 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.290795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e128783-8567-44d6-93d6-d94f3880ad99 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.292455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 504/1003] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:04.298095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da687a-11b5-42a3-b774-a257aff6e246 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.298602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da687a-11b5-42a3-b774-a257aff6e246 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.298675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da687a-11b5-42a3-b774-a257aff6e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.316800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d5da687a-11b5-42a3-b774-a257aff6e246 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:04.317994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d5da687a-11b5-42a3-b774-a257aff6e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:04.412743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 500/1004] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:04.690236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e128783-8567-44d6-93d6-d94f3880ad99 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.794725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e128783-8567-44d6-93d6-d94f3880ad99 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.828596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.829222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.829498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.829767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] PATH_INFO: `/v3/services/image` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.830350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:04.831733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:04.841050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:04.842064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:04.844400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 505/1005] 10.222.0.62 () {56 vars in 1105 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:04.848323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da687a-11b5-42a3-b774-a257aff6e246 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:04.914406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:04.960149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da687a-11b5-42a3-b774-a257aff6e246 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:04.996597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e0acd-266a-41dd-b703-18a06491fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:04.997197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0acd-266a-41dd-b703-18a06491fac6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:04.997474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0acd-266a-41dd-b703-18a06491fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:04.997743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0acd-266a-41dd-b703-18a06491fac6 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:04.998370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0acd-266a-41dd-b703-18a06491fac6 None admin] RBAC: Adding query filter params (name=image) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:04.998668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0acd-266a-41dd-b703-18a06491fac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.000050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0acd-266a-41dd-b703-18a06491fac6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.005075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 501/1006] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:05.011208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.031581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.112191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216feb6-c22a-4dc1-9779-7c13637f3ad3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.148557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c991ea-dc0e-4cc9-87b0-d16fbdbf5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.149162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c991ea-dc0e-4cc9-87b0-d16fbdbf5b00 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.149434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c991ea-dc0e-4cc9-87b0-d16fbdbf5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.149698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c991ea-dc0e-4cc9-87b0-d16fbdbf5b00 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.150328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c991ea-dc0e-4cc9-87b0-d16fbdbf5b00 None admin] RBAC: Adding query filter params (type=image) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:05.150631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c991ea-dc0e-4cc9-87b0-d16fbdbf5b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.152017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c991ea-dc0e-4cc9-87b0-d16fbdbf5b00 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.157125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 506/1007] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:05.213496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01b509-b752-4470-a3d6-e65f4e097825 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.213710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01b509-b752-4470-a3d6-e65f4e097825 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.213973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01b509-b752-4470-a3d6-e65f4e097825 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.215520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 502/1008] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:05.221226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fa7f-ce0b-4c8d-9e0f-6870ca22aa7c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.221510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fa7f-ce0b-4c8d-9e0f-6870ca22aa7c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.221787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fa7f-ce0b-4c8d-9e0f-6870ca22aa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.240797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-90f5fa7f-ce0b-4c8d-9e0f-6870ca22aa7c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:05.242070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-90f5fa7f-ce0b-4c8d-9e0f-6870ca22aa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:05.249561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedfae1-6999-45dd-82fc-3401a84616a5 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.249867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedfae1-6999-45dd-82fc-3401a84616a5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.250122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedfae1-6999-45dd-82fc-3401a84616a5 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.251645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 503/1009] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:05.257172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b8ef-cf5a-4a6d-b7d7-0f55e116b538 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.258005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b8ef-cf5a-4a6d-b7d7-0f55e116b538 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.258282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b8ef-cf5a-4a6d-b7d7-0f55e116b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.277402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7635b8ef-cf5a-4a6d-b7d7-0f55e116b538 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:05.278633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7635b8ef-cf5a-4a6d-b7d7-0f55e116b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:05.321470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 507/1010] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:05.358277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 504/1011] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:05.598927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fa7f-ce0b-4c8d-9e0f-6870ca22aa7c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.613552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.624869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b8ef-cf5a-4a6d-b7d7-0f55e116b538 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.685290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.705160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fa7f-ce0b-4c8d-9e0f-6870ca22aa7c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.730611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b8ef-cf5a-4a6d-b7d7-0f55e116b538 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.739119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.739888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.740165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.740435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.741020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.742964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:05.751840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:05.752834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:05.753700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 508/1012] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:05.759635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.772508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.773135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.773419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.773688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.774781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.776304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.779396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 505/1013] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:05.783398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.841738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.866087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d45609-9ee8-4e1c-9cb8-4a8876f6194e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.887338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd8049-148f-471f-a801-d1b62f61c8bc None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:05.901335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.901932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.902213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.902482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.903106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:05.903447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.904809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:05.909632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 509/1014] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:05.912644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:05.915246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:05.924873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:05.925592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:05.925869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:05.926147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:05.926798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:05.928426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.017624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3493c-bb03-400e-9b7b-a411bbb10636 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.039393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 506/1015] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:05 2022] POST /identity/v3/projects => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:06.056550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9f6c3-a99c-4b71-9d72-c68d0c29956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.057178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6c3-a99c-4b71-9d72-c68d0c29956e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.057455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6c3-a99c-4b71-9d72-c68d0c29956e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.057726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6c3-a99c-4b71-9d72-c68d0c29956e None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.058372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9f6c3-a99c-4b71-9d72-c68d0c29956e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:06.058674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9f6c3-a99c-4b71-9d72-c68d0c29956e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.060112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9f6c3-a99c-4b71-9d72-c68d0c29956e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.070804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 510/1016] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Aug 18 20:35:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:06.072527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:06.192997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905836c8-cfa0-4d7a-99d9-6ccc4e07c514 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:06.244462 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0b261-d751-4e9a-be8a-54680f3a98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:06.245363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0b261-d751-4e9a-be8a-54680f3a98e0 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:06.245783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0b261-d751-4e9a-be8a-54680f3a98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:06.246190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0b261-d751-4e9a-be8a-54680f3a98e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:06.247209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0b261-d751-4e9a-be8a-54680f3a98e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:06.249420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0b261-d751-4e9a-be8a-54680f3a98e0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:06.350397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 507/1017] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:07.058064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51314-e987-49c3-9494-2164e57bc658 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.059153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51314-e987-49c3-9494-2164e57bc658 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.059153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51314-e987-49c3-9494-2164e57bc658 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.060690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 511/1018] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:07.065869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a74c-77e8-4b14-8ffc-5a0b6f88a9d2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.066335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a74c-77e8-4b14-8ffc-5a0b6f88a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.066423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a74c-77e8-4b14-8ffc-5a0b6f88a9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.084556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4bb7a74c-77e8-4b14-8ffc-5a0b6f88a9d2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:07.086282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4bb7a74c-77e8-4b14-8ffc-5a0b6f88a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:07.114601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.163541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 508/1019] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:07 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:07.428890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff51314-e987-49c3-9494-2164e57bc658 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:07.434496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:07.534671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff51314-e987-49c3-9494-2164e57bc658 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:07.568789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc518a5-1800-4f08-92ff-e554b3aed6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:07.569392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc518a5-1800-4f08-92ff-e554b3aed6c7 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:07.569700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc518a5-1800-4f08-92ff-e554b3aed6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:07.569970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc518a5-1800-4f08-92ff-e554b3aed6c7 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:07.570665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc518a5-1800-4f08-92ff-e554b3aed6c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:07.572076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc518a5-1800-4f08-92ff-e554b3aed6c7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:07.671477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 512/1020] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:07 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:08.020322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48700e6-7367-4fd4-965f-fa7fdef23d7a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.020802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48700e6-7367-4fd4-965f-fa7fdef23d7a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.020952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48700e6-7367-4fd4-965f-fa7fdef23d7a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.022415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 509/1021] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:08.027564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052e7b-cc5c-48c9-bbdd-c34f327db929 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.027857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052e7b-cc5c-48c9-bbdd-c34f327db929 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.028132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052e7b-cc5c-48c9-bbdd-c34f327db929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.046131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0a052e7b-cc5c-48c9-bbdd-c34f327db929 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:08.047319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0a052e7b-cc5c-48c9-bbdd-c34f327db929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:08.108887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:08.124663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 513/1022] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:08.369052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3614-9988-4333-b22c-d12f0dddb102 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.369551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3614-9988-4333-b22c-d12f0dddb102 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.369665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3614-9988-4333-b22c-d12f0dddb102 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.371069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 510/1023] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:08.376043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad7d7-545a-432e-8481-f8c8e60675c2 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.376331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad7d7-545a-432e-8481-f8c8e60675c2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.376600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad7d7-545a-432e-8481-f8c8e60675c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.394841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3614-9988-4333-b22c-d12f0dddb102 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.395508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-19cad7d7-545a-432e-8481-f8c8e60675c2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:08.396702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-19cad7d7-545a-432e-8481-f8c8e60675c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:08.478713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 514/1024] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:08.502740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3614-9988-4333-b22c-d12f0dddb102 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.537213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.537887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.538084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.538886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.540044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:08.541483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:08.543214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 511/1025] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:08.548788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad7d7-545a-432e-8481-f8c8e60675c2 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.681944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad7d7-545a-432e-8481-f8c8e60675c2 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.696036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:08.710655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.711274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.711620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.711866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.712514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:08.713994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:08.750486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:08.780175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:08.799396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 515/1026] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:35:08 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:08.870378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8c5b-d985-438e-9113-8631bd0a7c98 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:08.907221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:08.907910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:08.908189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:08.908462 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:08.920742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:08.925591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:08.926834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:08.927966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 512/1027] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:08.937397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.064408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2fea6-8f39-496e-a2fb-e068a577fcc4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.098743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.099722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.100194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.100655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.102037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:09.102502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.104058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.113029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 516/1028] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:09.118945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.208742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:09.224754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba3d18-755f-4f58-b38d-e7a5f02cf32c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.259653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.260293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.260574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.260847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.277523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.279324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:09.303100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:09.304338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:09.305262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:09.305262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:09.305262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:09.305443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 513/1029] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:09.311535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.369424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:09.446317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94065f83-503b-414b-9e9d-fe886f961c89 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.485871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781a8df-8cbf-4037-89ee-3e27eafce641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.486411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a8df-8cbf-4037-89ee-3e27eafce641 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.486693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a8df-8cbf-4037-89ee-3e27eafce641 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.486970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a8df-8cbf-4037-89ee-3e27eafce641 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.487660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781a8df-8cbf-4037-89ee-3e27eafce641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:09.487971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781a8df-8cbf-4037-89ee-3e27eafce641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.489360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781a8df-8cbf-4037-89ee-3e27eafce641 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.503419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 517/1030] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:09.509642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.634616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83048-d046-43fe-a758-043d6e728efe None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.635067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83048-d046-43fe-a758-043d6e728efe None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.635572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83048-d046-43fe-a758-043d6e728efe None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.638559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 518/1031] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:09.642862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e4a4-9c31-4fdf-ab8a-1e1699160c04 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.645775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1831-3e42-4737-8a80-9d0df41549a4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.646069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1831-3e42-4737-8a80-9d0df41549a4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.646349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1831-3e42-4737-8a80-9d0df41549a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.665943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-06ba1831-3e42-4737-8a80-9d0df41549a4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:09.667462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-06ba1831-3e42-4737-8a80-9d0df41549a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:09.689291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61181f49-678d-4071-821c-c62394080a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.690009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61181f49-678d-4071-821c-c62394080a6b None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.690292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61181f49-678d-4071-821c-c62394080a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.690564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61181f49-678d-4071-821c-c62394080a6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.699869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61181f49-678d-4071-821c-c62394080a6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.701341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61181f49-678d-4071-821c-c62394080a6b None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.703572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-61181f49-678d-4071-821c-c62394080a6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:09.714559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:09.715626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:09.716585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 514/1032] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:09.722745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61181f49-678d-4071-821c-c62394080a6b None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.752949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 519/1033] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:09.847274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61181f49-678d-4071-821c-c62394080a6b None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:09.883853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:09.884473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:09.884757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:09.885033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:09.885778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:09.886093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:09.887835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:09.911402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 515/1034] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:09.913722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1831-3e42-4737-8a80-9d0df41549a4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:09.944483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.017635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.036100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1831-3e42-4737-8a80-9d0df41549a4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.073845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.074457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.074733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.075008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.085716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.145682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ba0c-183c-4074-8123-ae6f275172e0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.155961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.157420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.185412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.193276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.198980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.198980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.198980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] PATH_INFO: `/v3/services/image` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.198980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.198980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:10.207144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:10.208226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:10.213953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 516/1035] 10.222.0.62 () {56 vars in 1105 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:10.214979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.293261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 520/1036] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:10.299637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.363162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3547eab-2773-4774-9030-d52d016b9a9e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.388859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.403695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.404307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.404590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.404851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.405719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.406016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.407415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.412808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 517/1037] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:10.418965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.431311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f9ee-0140-4c2f-a4df-b90531198ae8 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.473548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.487976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.488609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.488884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.489379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.501669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.504370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:10.527873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:10.528944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:10.529937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:10.529937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:10.529937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:10.529937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 521/1038] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:10.534697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.551115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaaaf2-0e85-4d81-b408-079780e831e3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.586811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.587458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.587745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.588021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.588664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.588969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.590381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.600056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 518/1039] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:10.601880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.664165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744e0b3-46b8-43d4-be9d-e16e8cfc081a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.673616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.703510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.704465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.704841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.705253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.706049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.706610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.708213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.729585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 522/1040] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:10.730761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.739197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc705c1-992a-4eaa-8407-c27a8c9ce2f6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.780381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.782405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.783029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.783305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.783609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.784319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] RBAC: Adding query filter params (interface=public, service_id=b50cdbc86b374978b68fcf39fd9cb7f6, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:10.784628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.786035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.798167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 519/1041] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/endpoints?service_id=b50cdbc86b374978b68fcf39fd9cb7f6&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:10.798994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.850767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ca4b2-edf9-4cd0-8c5b-ed33febd5592 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.888376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d107dd5-b773-4d37-a186-82564c6a1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.889009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107dd5-b773-4d37-a186-82564c6a1e64 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.889296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107dd5-b773-4d37-a186-82564c6a1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.889568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107dd5-b773-4d37-a186-82564c6a1e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.896406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d107dd5-b773-4d37-a186-82564c6a1e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.897893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d107dd5-b773-4d37-a186-82564c6a1e64 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-5d107dd5-b773-4d37-a186-82564c6a1e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:10.909287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:10.910637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 523/1042] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:10.911777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732514-4d42-4e83-bce2-f74c0a8efc51 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.912319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732514-4d42-4e83-bce2-f74c0a8efc51 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.912319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732514-4d42-4e83-bce2-f74c0a8efc51 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.913968 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 524/1043] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:10.916081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732514-4d42-4e83-bce2-f74c0a8efc51 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:10.921768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eeb93-0036-496b-85d9-36d416d9ba50 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:10.935645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:10.959263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47777d6-8b43-4668-a93f-802fd561a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:10.959907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47777d6-8b43-4668-a93f-802fd561a76e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.960207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47777d6-8b43-4668-a93f-802fd561a76e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.960480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47777d6-8b43-4668-a93f-802fd561a76e None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.961101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47777d6-8b43-4668-a93f-802fd561a76e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:10.962760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47777d6-8b43-4668-a93f-802fd561a76e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:10.969088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 520/1044] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:35:10.970369 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2cfe-3d2d-4889-b2fa-b025051242c1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:10.970651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2cfe-3d2d-4889-b2fa-b025051242c1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:10.970922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2cfe-3d2d-4889-b2fa-b025051242c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:10.997284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-eb9b2cfe-3d2d-4889-b2fa-b025051242c1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:10.998521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-eb9b2cfe-3d2d-4889-b2fa-b025051242c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:11.050572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.056568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732514-4d42-4e83-bce2-f74c0a8efc51 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.097777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 521/1045] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:11.102174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.102690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.102971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.103247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.104041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:11.104350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.105845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.126013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 525/1046] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:11.127673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2cfe-3d2d-4889-b2fa-b025051242c1 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.257197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2cfe-3d2d-4889-b2fa-b025051242c1 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.265715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.307608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.308233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.308515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.308788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.309536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] RBAC: Adding query filter params (role.id=2569e4466fb341139e7126223b053b75, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=79b9a470bced4efcaef3ed849f6963fd) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:11.309846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.311275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.323406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 522/1047] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/role_assignments?user.id=79b9a470bced4efcaef3ed849f6963fd&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=2569e4466fb341139e7126223b053b75 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:11.373479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.495987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927c08c-1f0e-477e-b105-1725d7dcebb3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.534284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.534715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.534920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.535194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.547393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:11.552184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:11.553455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:11.555457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:11.558930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 526/1048] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:11.559978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.686729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9de9-e914-40df-88ea-9bf54bfb1887 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.716523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.717140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.717418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.717696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.718371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:11.718676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.720073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.730013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 523/1049] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:11.735772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.762950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:11.873091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6895ae-0c89-4942-b4ee-11cb96f405cd None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:11.910051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:11.910763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:11.911102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:11.911478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] PATH_INFO: `/v3/users/c7bfae789a6b4e07a1f9304e82bbf6e3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:11.926847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] RBAC: Authorizing `identity:get_user(user_id=c7bfae789a6b4e07a1f9304e82bbf6e3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:11.928343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:11.930101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 527/1050] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/users/c7bfae789a6b4e07a1f9304e82bbf6e3 => generated 285 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:11.937168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:11.972413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.046684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dd8e4-6524-4fb0-8cf7-5c5910600c7f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.082516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.083153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.083470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.083751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.166186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.168056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.203625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.287218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 524/1051] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:11 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:12.288947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.389638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.415579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d65f4c-74ee-4c71-be43-6a905e53ce08 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.457086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93405fa0-c21a-486c-9e18-5a0f0c397fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.457625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93405fa0-c21a-486c-9e18-5a0f0c397fbf None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.457903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93405fa0-c21a-486c-9e18-5a0f0c397fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.458193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93405fa0-c21a-486c-9e18-5a0f0c397fbf None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.459439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93405fa0-c21a-486c-9e18-5a0f0c397fbf None admin] RBAC: Authorizing `identity:get_project(project_id=4c23f03e1b4e479fba617f745cb91790)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.461031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93405fa0-c21a-486c-9e18-5a0f0c397fbf None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.462851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 528/1052] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:12.468938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:12.579547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a3bf7-416d-4b65-90b0-58ab554b3b0d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:12.613447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:12.621608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caab0-65ed-440a-b5e1-db308dc9d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:12.635823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caab0-65ed-440a-b5e1-db308dc9d4be None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.635823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caab0-65ed-440a-b5e1-db308dc9d4be None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.635823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caab0-65ed-440a-b5e1-db308dc9d4be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.635823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caab0-65ed-440a-b5e1-db308dc9d4be None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=4c23f03e1b4e479fba617f745cb91790, user.id=c7bfae789a6b4e07a1f9304e82bbf6e3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:12.635823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caab0-65ed-440a-b5e1-db308dc9d4be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:12.635823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caab0-65ed-440a-b5e1-db308dc9d4be None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:12.636264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 525/1053] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:12 2022] GET /identity/v3/role_assignments?user.id=c7bfae789a6b4e07a1f9304e82bbf6e3&scope.project.id=4c23f03e1b4e479fba617f745cb91790&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:12.939850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b082c-8ba8-4001-90a1-0bef3271ba8a None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.940127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b082c-8ba8-4001-90a1-0bef3271ba8a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.940431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b082c-8ba8-4001-90a1-0bef3271ba8a None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.941888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 529/1054] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:12.947729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590298-aabe-481a-893a-cdb8d03addaf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:12.948026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590298-aabe-481a-893a-cdb8d03addaf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:12.948303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590298-aabe-481a-893a-cdb8d03addaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:12.968209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4b590298-aabe-481a-893a-cdb8d03addaf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:12.970039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4b590298-aabe-481a-893a-cdb8d03addaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:13.055342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 526/1055] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:13.232954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba97e2-c99f-41f8-96b4-281bc2253be4 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.233144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba97e2-c99f-41f8-96b4-281bc2253be4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.233418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba97e2-c99f-41f8-96b4-281bc2253be4 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.234905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 530/1056] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:13.240029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f219-f805-47ec-8800-6f5f04613515 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.240326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f219-f805-47ec-8800-6f5f04613515 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.240604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f219-f805-47ec-8800-6f5f04613515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.260197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b8c6f219-f805-47ec-8800-6f5f04613515 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:13.261668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b8c6f219-f805-47ec-8800-6f5f04613515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:13.335088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba97e2-c99f-41f8-96b4-281bc2253be4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.338813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 527/1057] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:13.468928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba97e2-c99f-41f8-96b4-281bc2253be4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.518611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a09993-5940-430a-b897-c52430061471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.519315 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a09993-5940-430a-b897-c52430061471 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.519620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a09993-5940-430a-b897-c52430061471 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.519889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a09993-5940-430a-b897-c52430061471 None admin] PATH_INFO: `/v3/services/image` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.520477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a09993-5940-430a-b897-c52430061471 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.521834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a09993-5940-430a-b897-c52430061471 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-98a09993-5940-430a-b897-c52430061471 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:13.531032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:13.535648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:13.536551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 531/1058] 10.222.0.62 () {56 vars in 1105 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:13.538941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6f219-f805-47ec-8800-6f5f04613515 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.601155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.608673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a09993-5940-430a-b897-c52430061471 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.624500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.656509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6f219-f805-47ec-8800-6f5f04613515 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.698602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.699228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.699553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.699831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.700556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] RBAC: Adding query filter params (name=image) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:13.700869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.702252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.708695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 528/1059] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:13.714378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.748581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a09993-5940-430a-b897-c52430061471 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.792262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.792848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.793137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.793409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.808507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:13.813281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:13.814220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:13.815080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 532/1060] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:13.820437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.844719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c106201-eaa5-48a5-ba5f-ce97d8f0657e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.874045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.889473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.890342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.890629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.894131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.894131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] RBAC: Adding query filter params (type=image) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:13.894131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:13.894131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:13.903595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 529/1061] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:13.904529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:13.915228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:13.949393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccb332-f88e-4334-9270-b8c66d9f0948 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:13.996777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:13.997403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:13.997687 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:13.997963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:13.998648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:13.998956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.000369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.011644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 533/1062] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:14.015820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.041209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7972e-1fed-4e60-a18f-ffdd489ac471 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.077057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.077579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.077864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.078142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.078828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.080256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.138499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c98cf8-12cd-4c50-bfba-645ff0d572e1 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.171429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.179585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 530/1063] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:35:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:14.184118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.185070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.185503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.185942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.199937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.201676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:14.223439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:14.224700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:14.225861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:14.225861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:14.225861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:14.227521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 534/1064] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:14.233611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.286460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.379670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0700-9e02-4e34-811b-d2c4a0ad87e0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.422809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b21f4-a066-43ae-9cd8-332ff0187729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.423562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b21f4-a066-43ae-9cd8-332ff0187729 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.423848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b21f4-a066-43ae-9cd8-332ff0187729 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.424124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b21f4-a066-43ae-9cd8-332ff0187729 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.424790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b21f4-a066-43ae-9cd8-332ff0187729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:14.425094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b21f4-a066-43ae-9cd8-332ff0187729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.427829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b21f4-a066-43ae-9cd8-332ff0187729 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.443603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 531/1065] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:14.449637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.580135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3af5a4-4038-411a-9b31-302599febfdc None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.613581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb45c-cc37-4972-95b0-e69f5f191273 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.614078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb45c-cc37-4972-95b0-e69f5f191273 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.614078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb45c-cc37-4972-95b0-e69f5f191273 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.615541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 532/1066] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:14.620723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca44ca-565a-4de0-8878-e4a6161f098f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.621008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca44ca-565a-4de0-8878-e4a6161f098f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.621355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca44ca-565a-4de0-8878-e4a6161f098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.622616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.623255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.623575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.623850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.632839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.634297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.640245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-74ca44ca-565a-4de0-8878-e4a6161f098f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:14.641721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-74ca44ca-565a-4de0-8878-e4a6161f098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:14.646490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:14.648051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:14.648999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:14.653150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 535/1067] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:14.653839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.708761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.730213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 533/1068] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:14.793856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79007b7-b438-4475-990c-99963e02df78 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.830949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:14.831583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:14.831860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:14.832169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:14.832863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:14.833169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:14.834670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:14.860113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 536/1069] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:14.861234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca44ca-565a-4de0-8878-e4a6161f098f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:14.904598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:14.986417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca44ca-565a-4de0-8878-e4a6161f098f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:14.999049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.032494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.033136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.033418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.033707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.047465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.048937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:15.064071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:15.065076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:15.066170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:15.066170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:15.066170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:15.066170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 534/1070] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:15.071527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.132569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.137479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829074a4-4108-48b9-bb8f-86d90c36c8e7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.179429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.184512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.185213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.185437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.185704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.201142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:15.206722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e7070-65ce-4df4-b3eb-510f5ced48a4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:15.206900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:15.208211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:15.209489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 537/1071] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:15.214294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.253120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.253730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.254010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.254284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.254936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:15.255239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.257165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.270556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 535/1072] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:15.276569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.336331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5f09-cbd6-457e-b6ef-52fa73d9aec2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.400156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.400761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.401038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.401307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.401979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:15.402277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.404273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.419498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 538/1073] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:15.419693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40a2ab-a11a-4ad9-91d3-67bf2cfd2cd4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.420659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.443554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.456906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.462389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.462389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.462389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.465391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.466850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:15.478907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:15.480068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:15.481159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:15.484982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 536/1074] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:15.486179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.489093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.560889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce4a9a-305e-46f8-9ba7-8ca696efdd1f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.600950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.601627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.601852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.602272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] PATH_INFO: `/v3/users/c7bfae789a6b4e07a1f9304e82bbf6e3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.603241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] RBAC: Authorizing `identity:get_user(user_id=c7bfae789a6b4e07a1f9304e82bbf6e3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.604747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.606650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 539/1075] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/users/c7bfae789a6b4e07a1f9304e82bbf6e3 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:15.612426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.618769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3de9-188b-4485-b149-312f8e2bbdea None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.658314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.659455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.659739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.660007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.660707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:15.661374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.663191 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.682551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 537/1076] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:15.684288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.722287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.739481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091aa2c3-df96-4632-ac6f-bef85bd7744a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.754934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:15.777925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.778558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.778832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.779100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.780675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] RBAC: Authorizing `identity:get_project(project_id=4c23f03e1b4e479fba617f745cb91790)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.781708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.789125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 540/1077] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:15 2022] GET /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:15.790189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:15.807672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665b73e-31a5-4dae-bb74-73ea52c719e0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.844233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5d63-eabd-4da5-82c2-beee97557ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.844901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5d63-eabd-4da5-82c2-beee97557ffb None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.845240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5d63-eabd-4da5-82c2-beee97557ffb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.845515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5d63-eabd-4da5-82c2-beee97557ffb None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/79b9a470bced4efcaef3ed849f6963fd/roles/2569e4466fb341139e7126223b053b75` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.847754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd5d63-eabd-4da5-82c2-beee97557ffb None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=79b9a470bced4efcaef3ed849f6963fd, role_id=2569e4466fb341139e7126223b053b75)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.849209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd5d63-eabd-4da5-82c2-beee97557ffb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:15.900837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eaecc-3b8d-48e3-a47e-d44c45ac0e76 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:15.904893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 538/1078] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:15 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/79b9a470bced4efcaef3ed849f6963fd/roles/2569e4466fb341139e7126223b053b75 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:35:15.957883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19d36-0f0d-472a-812f-d3e87a4c5603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:15.957883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19d36-0f0d-472a-812f-d3e87a4c5603 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:15.957883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19d36-0f0d-472a-812f-d3e87a4c5603 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:15.957883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19d36-0f0d-472a-812f-d3e87a4c5603 None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790/users/c7bfae789a6b4e07a1f9304e82bbf6e3/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:15.960705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19d36-0f0d-472a-812f-d3e87a4c5603 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c23f03e1b4e479fba617f745cb91790, user_id=c7bfae789a6b4e07a1f9304e82bbf6e3, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:15.962196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19d36-0f0d-472a-812f-d3e87a4c5603 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:16.020641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 541/1079] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:15 2022] PUT /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790/users/c7bfae789a6b4e07a1f9304e82bbf6e3/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:35:16.226660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad3923-cde0-4c53-9aef-6d660c4835f6 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.227017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad3923-cde0-4c53-9aef-6d660c4835f6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.227216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad3923-cde0-4c53-9aef-6d660c4835f6 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.228638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 539/1080] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:16.234182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fa13e-5543-4b15-afce-ef155c0dbf30 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.234474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fa13e-5543-4b15-afce-ef155c0dbf30 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.234749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fa13e-5543-4b15-afce-ef155c0dbf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.253542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-b39fa13e-5543-4b15-afce-ef155c0dbf30 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:16.254764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b39fa13e-5543-4b15-afce-ef155c0dbf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:16.270125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:16.336094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 542/1081] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:16.615248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad3923-cde0-4c53-9aef-6d660c4835f6 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:16.749445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad3923-cde0-4c53-9aef-6d660c4835f6 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:16.774129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:16.786328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:16.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:16.787236 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:16.787541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:16.866267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:16.867700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:16.990240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 540/1082] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:16.996255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fa13e-5543-4b15-afce-ef155c0dbf30 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.106103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fa13e-5543-4b15-afce-ef155c0dbf30 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.156851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b70ea2-6be9-4adf-9724-2cee182a7e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.157398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70ea2-6be9-4adf-9724-2cee182a7e29 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.157672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70ea2-6be9-4adf-9724-2cee182a7e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.157937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70ea2-6be9-4adf-9724-2cee182a7e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.169554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b70ea2-6be9-4adf-9724-2cee182a7e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.171000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b70ea2-6be9-4adf-9724-2cee182a7e29 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.178833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-b3b70ea2-6be9-4adf-9724-2cee182a7e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:17.186983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:17.193713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:17.195165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:17.195165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:17.195165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:17.195165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 543/1083] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:17.197120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:17.227347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:17.325479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa9f30-8d81-4194-8a6b-0217b3e0655d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:17.366293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd261a65-fec0-42fc-91d5-98fbae6106be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:17.366918 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261a65-fec0-42fc-91d5-98fbae6106be None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.367202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261a65-fec0-42fc-91d5-98fbae6106be None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.367513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261a65-fec0-42fc-91d5-98fbae6106be None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.368171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd261a65-fec0-42fc-91d5-98fbae6106be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:17.368479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd261a65-fec0-42fc-91d5-98fbae6106be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:17.369861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd261a65-fec0-42fc-91d5-98fbae6106be None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:17.391399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 541/1084] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:17.873984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd51e-4212-478d-9289-8eee90e16d4b None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.874280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd51e-4212-478d-9289-8eee90e16d4b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.874557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd51e-4212-478d-9289-8eee90e16d4b None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.876107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 544/1085] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:17.881510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a145d4-8955-43dc-a7ed-583e045d8585 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.882544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a145d4-8955-43dc-a7ed-583e045d8585 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.882662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a145d4-8955-43dc-a7ed-583e045d8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.901126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-38a145d4-8955-43dc-a7ed-583e045d8585 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:17.902311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-38a145d4-8955-43dc-a7ed-583e045d8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:17.971196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dec8d3-e2cf-4c26-bff3-bb3953b509aa None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.971516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dec8d3-e2cf-4c26-bff3-bb3953b509aa None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.972195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dec8d3-e2cf-4c26-bff3-bb3953b509aa None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:17.972300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 542/1086] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:17.973254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 545/1087] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:35:17.981674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e467bd-c42e-452d-a5db-d691876e2a5b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:17.981970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e467bd-c42e-452d-a5db-d691876e2a5b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:17.982248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e467bd-c42e-452d-a5db-d691876e2a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.001073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-78e467bd-c42e-452d-a5db-d691876e2a5b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:18.002256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-78e467bd-c42e-452d-a5db-d691876e2a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:18.010233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.080221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 543/1088] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:18.243486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dec8d3-e2cf-4c26-bff3-bb3953b509aa None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.346795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e467bd-c42e-452d-a5db-d691876e2a5b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.353072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dec8d3-e2cf-4c26-bff3-bb3953b509aa None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.389632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.390264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.390541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.390810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.402359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:18.407043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:18.408071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:18.408922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 546/1089] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:18.414598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.455306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e467bd-c42e-452d-a5db-d691876e2a5b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.471237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.490326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.491021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.491303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.491629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.503016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:18.507914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:18.509062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:18.509907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 544/1090] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:18.515394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.518495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec799489-0757-4ddc-bf00-bf4180f18cd0 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.519169 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.556018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.556667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.556952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.557229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.557937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:18.558245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.559651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.568135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 547/1091] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:18.574004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.652356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934e93-fb41-41f6-9af6-0fe1d477bd56 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.677844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bead50-a492-4add-8743-990895ac3fd3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.689711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.690325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.690609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.690890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.691598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:18.691909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.693328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.700772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.702835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 545/1092] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:18.711505 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.720411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.720411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.720411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.720747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.732034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.733492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:18.748032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:18.749074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:18.750040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:18.750040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:18.750040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:18.750040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 548/1093] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:18.756120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.788589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:18.830650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdc96b-c375-457a-bd4b-e8d44fcd14fb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.884166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.885262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.885767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.886503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] PATH_INFO: `/v3/users/c7bfae789a6b4e07a1f9304e82bbf6e3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.889214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] RBAC: Authorizing `identity:get_user(user_id=c7bfae789a6b4e07a1f9304e82bbf6e3)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.891973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.900202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 546/1094] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/users/c7bfae789a6b4e07a1f9304e82bbf6e3 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:18.901609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:18.911392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc7361-82fd-44ae-b5bf-49d092d7b7ce None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:18.949935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:18.950550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:18.950831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:18.951103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:18.951787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:18.952095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:18.954131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:18.975182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 549/1095] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:18.981353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.029900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2d5a-6d66-4b58-bed4-b4e6a83aa019 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.031314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.070504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.075590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.076209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.076487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.076762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.122441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434ef8a-528f-44b6-9020-d6bab897d1f0 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.162223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.164010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.166859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.167524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.167800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.168064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.175721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.177170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:35:19.193755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:19.195620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:19.196869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 550/1096] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:35:19.201306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.284718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 547/1097] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:19.291335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.303999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.312762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cedd3-3f00-4b3c-b6f0-10e205e1b1d5 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.325712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.353517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.354464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.354842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.357795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.357795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:19.357795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.357795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.376710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 551/1098] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Aug 18 20:35:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:35:19.382953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.398131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadd668-56e6-4365-9d64-ccf285e599b0 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.434587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.435220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.435529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.435801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.436929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] RBAC: Authorizing `identity:get_project(project_id=4c23f03e1b4e479fba617f745cb91790)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.438403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.440354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 548/1099] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:19 2022] GET /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:19.446808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.500681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453ba9c-177c-41a5-acf9-c5849655daba None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.547619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.548150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.548555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.549025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.572927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.576440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a9c5-5c8c-442a-9021-e206716c1a70 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.583857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:19.624536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.625442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.625868 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.626286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.627476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=4c23f03e1b4e479fba617f745cb91790, user.id=c7bfae789a6b4e07a1f9304e82bbf6e3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:19.627959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.630234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.638017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.639622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.651424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 549/1100] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:19 2022] GET /identity/v3/role_assignments?user.id=c7bfae789a6b4e07a1f9304e82bbf6e3&scope.project.id=4c23f03e1b4e479fba617f745cb91790&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:19.762356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 552/1101] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:19.768504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:19.891208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92430-0e1c-4004-9e5a-4294b98ca90e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:19.926146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:19.926793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:19.927073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:19.927346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:19.939049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:19.940552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:19.969748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:19.971096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:35:19.972916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:19.972916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:35:19.972916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:19.972916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 550/1102] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:19.979630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:20.035050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:20.086859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc92aa-1e54-4bc4-8a9a-089bc5f956e4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:20.126358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:20.127222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.127575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.127854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.128777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:20.129276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:20.130880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:20.143768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 553/1103] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:20.149331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:20.168668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:20.254695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd73f9-454e-4207-9545-be32508bece4 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:20.292550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:20.293335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.293621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.293898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.300980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:20.302435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:35:20.314542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:20.315615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:20.316840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 551/1104] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:20.321565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:20.431867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cfd8c-a837-4b6a-bac4-03a278358836 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:20.442399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:20.469546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39936aed-4ea8-4535-a965-8fbddc1d6d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:20.470159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39936aed-4ea8-4535-a965-8fbddc1d6d50 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.470441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39936aed-4ea8-4535-a965-8fbddc1d6d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.470713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39936aed-4ea8-4535-a965-8fbddc1d6d50 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.471445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39936aed-4ea8-4535-a965-8fbddc1d6d50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:20.471757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39936aed-4ea8-4535-a965-8fbddc1d6d50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:20.473183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39936aed-4ea8-4535-a965-8fbddc1d6d50 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:20.485997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 554/1105] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:20.492678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:20.578509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:20.602808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97203c-256e-40d7-b5ab-6ca653430aa3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:20.637604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c492532-924d-41b9-b458-2fb86c2cd29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:20.638202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c492532-924d-41b9-b458-2fb86c2cd29f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:20.638484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c492532-924d-41b9-b458-2fb86c2cd29f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:20.638760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c492532-924d-41b9-b458-2fb86c2cd29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:20.639651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c492532-924d-41b9-b458-2fb86c2cd29f None admin] RBAC: Adding query filter params (role.id=2569e4466fb341139e7126223b053b75, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=79b9a470bced4efcaef3ed849f6963fd) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:20.640253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c492532-924d-41b9-b458-2fb86c2cd29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:20.641439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c492532-924d-41b9-b458-2fb86c2cd29f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:20.648550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 552/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:20 2022] GET /identity/v3/role_assignments?user.id=79b9a470bced4efcaef3ed849f6963fd&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=2569e4466fb341139e7126223b053b75 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:21.594078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb346aa-afeb-4d1d-8f5b-10e29da220fb None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.594626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb346aa-afeb-4d1d-8f5b-10e29da220fb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.594626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb346aa-afeb-4d1d-8f5b-10e29da220fb None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.596074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 555/1107] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:21.601693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf19b4-193d-4d7a-9d5c-2759ee60fdbf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:21.602143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf19b4-193d-4d7a-9d5c-2759ee60fdbf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:21.602249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf19b4-193d-4d7a-9d5c-2759ee60fdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:21.620707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4abf19b4-193d-4d7a-9d5c-2759ee60fdbf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:21.621836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4abf19b4-193d-4d7a-9d5c-2759ee60fdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:21.715183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 553/1108] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:21.985014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb346aa-afeb-4d1d-8f5b-10e29da220fb None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.089147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb346aa-afeb-4d1d-8f5b-10e29da220fb None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.123859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aca4fd-3022-465c-990a-e8f1b55adf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.124481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca4fd-3022-465c-990a-e8f1b55adf1b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.124761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca4fd-3022-465c-990a-e8f1b55adf1b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.125053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca4fd-3022-465c-990a-e8f1b55adf1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.126150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aca4fd-3022-465c-990a-e8f1b55adf1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.127609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aca4fd-3022-465c-990a-e8f1b55adf1b None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.129193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 556/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:22.135638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf19b4-193d-4d7a-9d5c-2759ee60fdbf None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:22.203288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:22.234468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf19b4-193d-4d7a-9d5c-2759ee60fdbf None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:22.269186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dbe2c-8c36-4c23-94f6-b7b70028e5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:22.269801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dbe2c-8c36-4c23-94f6-b7b70028e5a6 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:22.270083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dbe2c-8c36-4c23-94f6-b7b70028e5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:22.270356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dbe2c-8c36-4c23-94f6-b7b70028e5a6 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:22.271033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dbe2c-8c36-4c23-94f6-b7b70028e5a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:22.272541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dbe2c-8c36-4c23-94f6-b7b70028e5a6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:22.390125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 554/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:35:22 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:24.378867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e50ca-08c9-473a-bd3f-94c359adc8bc None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.379432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e50ca-08c9-473a-bd3f-94c359adc8bc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.379432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e50ca-08c9-473a-bd3f-94c359adc8bc None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.380774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 557/1111] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:24.387172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419404cd-060b-4610-b892-0d92d5825d7e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.387710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419404cd-060b-4610-b892-0d92d5825d7e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.387812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419404cd-060b-4610-b892-0d92d5825d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.411220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-419404cd-060b-4610-b892-0d92d5825d7e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:24.412454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-419404cd-060b-4610-b892-0d92d5825d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:24.480865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 555/1112] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:24.751503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e50ca-08c9-473a-bd3f-94c359adc8bc None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:24.801622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:24.861906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e50ca-08c9-473a-bd3f-94c359adc8bc None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:24.898372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:24.899040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:24.899327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:24.899638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] PATH_INFO: `/v3/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:24.901038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] RBAC: Authorizing `identity:get_role(role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:24.902453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:24.903850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 558/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:24 2022] GET /identity/v3/roles/f84356f9eb7648808591d233bb604d18 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:24.909748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419404cd-060b-4610-b892-0d92d5825d7e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:24.967003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.013224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419404cd-060b-4610-b892-0d92d5825d7e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.065296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.065944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.066226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.066582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] PATH_INFO: `/v3/users/fa80adfdad78434eabd799d4f79dfac3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.081839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] RBAC: Authorizing `identity:get_user(user_id=fa80adfdad78434eabd799d4f79dfac3)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.083540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.086156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 556/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:24 2022] GET /identity/v3/users/fa80adfdad78434eabd799d4f79dfac3 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:25.091953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.206265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111f6e-dac7-4b10-8c90-f3af36faf668 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.217044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.244355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.245062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.245383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.245626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.321618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.322990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.430699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 559/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:35:25.436960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.536775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe397a-d612-4a47-ac73-83468fdd9c49 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.550713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.570824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2dfa0-7203-42f6-9f3d-bfa93b048b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.577289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2dfa0-7203-42f6-9f3d-bfa93b048b00 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.577289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2dfa0-7203-42f6-9f3d-bfa93b048b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.577289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2dfa0-7203-42f6-9f3d-bfa93b048b00 None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.577289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2dfa0-7203-42f6-9f3d-bfa93b048b00 None admin] RBAC: Authorizing `identity:get_project(project_id=4c23f03e1b4e479fba617f745cb91790)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.577289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2dfa0-7203-42f6-9f3d-bfa93b048b00 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.577289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 557/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:25.582766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:25.591617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:25.685354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306733e8-abd4-4f1f-9acb-22e654184b2d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:25.718586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977b222-ae72-4a4d-9fc2-a7c7365eede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:25.719192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b222-ae72-4a4d-9fc2-a7c7365eede7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:25.719511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b222-ae72-4a4d-9fc2-a7c7365eede7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:25.719788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b222-ae72-4a4d-9fc2-a7c7365eede7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:25.720518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b222-ae72-4a4d-9fc2-a7c7365eede7 None admin] RBAC: Adding query filter params (role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=4c23f03e1b4e479fba617f745cb91790, user.id=fa80adfdad78434eabd799d4f79dfac3) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:25.720830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b222-ae72-4a4d-9fc2-a7c7365eede7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:25.722254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b222-ae72-4a4d-9fc2-a7c7365eede7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:25.728363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 560/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:25 2022] GET /identity/v3/role_assignments?user.id=fa80adfdad78434eabd799d4f79dfac3&scope.project.id=4c23f03e1b4e479fba617f745cb91790&role.id=f84356f9eb7648808591d233bb604d18 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:27.621853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f3fdd-7972-4bd9-8f50-3fbf87a304fe None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.622429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f3fdd-7972-4bd9-8f50-3fbf87a304fe None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.622429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f3fdd-7972-4bd9-8f50-3fbf87a304fe None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.623699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 558/1118] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:27.628998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3173-6451-401c-9d6f-74a3fc5de4fc None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:27.629429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3173-6451-401c-9d6f-74a3fc5de4fc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:27.629552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3173-6451-401c-9d6f-74a3fc5de4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:27.648570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-088c3173-6451-401c-9d6f-74a3fc5de4fc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:27.649781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-088c3173-6451-401c-9d6f-74a3fc5de4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:27.713609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:27.719202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 561/1119] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:35:27.980965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f3fdd-7972-4bd9-8f50-3fbf87a304fe None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.086699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f3fdd-7972-4bd9-8f50-3fbf87a304fe None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.121033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.121676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.121952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.122222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] PATH_INFO: `/v3/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.123681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] RBAC: Authorizing `identity:get_role(role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.125048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.126373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 559/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:27 2022] GET /identity/v3/roles/f84356f9eb7648808591d233bb604d18 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:28.132883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c3173-6451-401c-9d6f-74a3fc5de4fc None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.242022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c3173-6451-401c-9d6f-74a3fc5de4fc None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.276457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.277083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.277364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.277638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] PATH_INFO: `/v3/users/fa80adfdad78434eabd799d4f79dfac3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.278776 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] RBAC: Authorizing `identity:get_user(user_id=fa80adfdad78434eabd799d4f79dfac3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.280248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.281871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 562/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/users/fa80adfdad78434eabd799d4f79dfac3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:28.288312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.337590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.394217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deeee7-8def-4615-8552-fff323cb77ec None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.429856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b241-3f8f-4b2f-ad8b-fa60c3d67134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.430483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b241-3f8f-4b2f-ad8b-fa60c3d67134 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.430763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b241-3f8f-4b2f-ad8b-fa60c3d67134 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.431038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b241-3f8f-4b2f-ad8b-fa60c3d67134 None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.432195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b241-3f8f-4b2f-ad8b-fa60c3d67134 None admin] RBAC: Authorizing `identity:get_project(project_id=4c23f03e1b4e479fba617f745cb91790)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.433623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b241-3f8f-4b2f-ad8b-fa60c3d67134 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.435274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 560/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:28 2022] GET /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:28.441281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:28.509689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:28.544487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088b78-271a-4ae6-99fc-566c2d6a3db7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:28.578319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db370323-53fa-4c69-a16e-68985f5afea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:28.578975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db370323-53fa-4c69-a16e-68985f5afea2 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:28.579257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db370323-53fa-4c69-a16e-68985f5afea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:28.579562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db370323-53fa-4c69-a16e-68985f5afea2 None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790/users/fa80adfdad78434eabd799d4f79dfac3/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:28.581741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db370323-53fa-4c69-a16e-68985f5afea2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c23f03e1b4e479fba617f745cb91790, user_id=fa80adfdad78434eabd799d4f79dfac3, role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:28.583172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db370323-53fa-4c69-a16e-68985f5afea2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:28.646068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 563/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:28 2022] PUT /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790/users/fa80adfdad78434eabd799d4f79dfac3/roles/f84356f9eb7648808591d233bb604d18 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:35:30.518593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0fe2-df1f-4003-ba4f-cbfd08879f56 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:30.519182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0fe2-df1f-4003-ba4f-cbfd08879f56 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:30.519182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0fe2-df1f-4003-ba4f-cbfd08879f56 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:30.520487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 561/1124] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:30.525962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f736-ea25-4d7f-86a1-6fe40b15a82c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:30.526446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f736-ea25-4d7f-86a1-6fe40b15a82c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:30.526551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f736-ea25-4d7f-86a1-6fe40b15a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:30.544396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1b77f736-ea25-4d7f-86a1-6fe40b15a82c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:30.545625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1b77f736-ea25-4d7f-86a1-6fe40b15a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:30.612813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 564/1125] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:30.888508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0fe2-df1f-4003-ba4f-cbfd08879f56 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:30.991137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0fe2-df1f-4003-ba4f-cbfd08879f56 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.008395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.031148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.031816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.032098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.032374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] PATH_INFO: `/v3/roles/f84356f9eb7648808591d233bb604d18` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.033893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] RBAC: Authorizing `identity:get_role(role_id=f84356f9eb7648808591d233bb604d18)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.035262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.036633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 562/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:30 2022] GET /identity/v3/roles/f84356f9eb7648808591d233bb604d18 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:31.043032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f736-ea25-4d7f-86a1-6fe40b15a82c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.105561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.152704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f736-ea25-4d7f-86a1-6fe40b15a82c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.187964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.188597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.188878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.189152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] PATH_INFO: `/v3/users/fa80adfdad78434eabd799d4f79dfac3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.190299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] RBAC: Authorizing `identity:get_user(user_id=fa80adfdad78434eabd799d4f79dfac3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.191773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.193405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 565/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/users/fa80adfdad78434eabd799d4f79dfac3 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:31.199310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.302820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace969-bd1e-4130-9a0e-52e8b5ef27cd None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.339464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.340090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.340370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.340645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.396078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.409890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.411420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.513724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 563/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:31.519746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.620297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ad81-5f5e-4200-9839-2ed2f3723198 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.653710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.668133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4dbee-37f4-4151-b95e-66ba297af695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.668133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4dbee-37f4-4151-b95e-66ba297af695 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.668133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4dbee-37f4-4151-b95e-66ba297af695 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.668133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4dbee-37f4-4151-b95e-66ba297af695 None admin] PATH_INFO: `/v3/projects/4c23f03e1b4e479fba617f745cb91790` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.668865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4dbee-37f4-4151-b95e-66ba297af695 None admin] RBAC: Authorizing `identity:get_project(project_id=4c23f03e1b4e479fba617f745cb91790)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.668865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4dbee-37f4-4151-b95e-66ba297af695 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.668865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 566/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/projects/4c23f03e1b4e479fba617f745cb91790 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:31.673831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:31.769957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:31.785202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdf431-9e7f-40d7-903f-27095a6bbd8f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:31.819700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92f5f5-fe50-4868-933a-992512a73e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:31.820308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92f5f5-fe50-4868-933a-992512a73e24 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:31.820590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92f5f5-fe50-4868-933a-992512a73e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:31.820863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92f5f5-fe50-4868-933a-992512a73e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:31.821597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92f5f5-fe50-4868-933a-992512a73e24 None admin] RBAC: Adding query filter params (role.id=f84356f9eb7648808591d233bb604d18, scope.project.id=4c23f03e1b4e479fba617f745cb91790, user.id=fa80adfdad78434eabd799d4f79dfac3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:31.821905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92f5f5-fe50-4868-933a-992512a73e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:31.823341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92f5f5-fe50-4868-933a-992512a73e24 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:31.829310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 564/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:31 2022] GET /identity/v3/role_assignments?user.id=fa80adfdad78434eabd799d4f79dfac3&scope.project.id=4c23f03e1b4e479fba617f745cb91790&role.id=f84356f9eb7648808591d233bb604d18 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:33.769319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639101-8948-4894-b235-8c845a00ff50 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:33.769865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639101-8948-4894-b235-8c845a00ff50 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:33.769865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639101-8948-4894-b235-8c845a00ff50 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:33.771214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 567/1131] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:33.776786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de9312-6f0f-474f-8d7e-6e9d73bdc758 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:33.777199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de9312-6f0f-474f-8d7e-6e9d73bdc758 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:33.777348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de9312-6f0f-474f-8d7e-6e9d73bdc758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:33.795710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d1de9312-6f0f-474f-8d7e-6e9d73bdc758 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:33.796917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d1de9312-6f0f-474f-8d7e-6e9d73bdc758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:33.863739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 565/1132] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:34.133682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639101-8948-4894-b235-8c845a00ff50 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:34.232314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639101-8948-4894-b235-8c845a00ff50 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:34.266511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e4be-d499-43e8-a16f-69caf7189663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:34.267139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e4be-d499-43e8-a16f-69caf7189663 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:34.267451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e4be-d499-43e8-a16f-69caf7189663 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:34.267734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e4be-d499-43e8-a16f-69caf7189663 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:34.268857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68e4be-d499-43e8-a16f-69caf7189663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:34.270289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68e4be-d499-43e8-a16f-69caf7189663 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:34.271925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 568/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:34.277884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de9312-6f0f-474f-8d7e-6e9d73bdc758 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:34.356026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:34.374912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de9312-6f0f-474f-8d7e-6e9d73bdc758 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:34.411510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a132c4-4385-4161-a0de-899066d5b1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:34.412027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a132c4-4385-4161-a0de-899066d5b1c6 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:34.412307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a132c4-4385-4161-a0de-899066d5b1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:34.412581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a132c4-4385-4161-a0de-899066d5b1c6 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:34.413225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a132c4-4385-4161-a0de-899066d5b1c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:34.414652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a132c4-4385-4161-a0de-899066d5b1c6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:34.499343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 566/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:34 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:36.474211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a483a33-4d48-42f0-a4b4-ef4d564d3dbb None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:36.474735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a483a33-4d48-42f0-a4b4-ef4d564d3dbb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:36.474735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a483a33-4d48-42f0-a4b4-ef4d564d3dbb None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:36.476262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 569/1135] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:36.484571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef8050-17eb-4ab7-a2fc-a2e2398e69bd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:36.484990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef8050-17eb-4ab7-a2fc-a2e2398e69bd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:36.485386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef8050-17eb-4ab7-a2fc-a2e2398e69bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:36.504134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e3ef8050-17eb-4ab7-a2fc-a2e2398e69bd None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:36.505323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e3ef8050-17eb-4ab7-a2fc-a2e2398e69bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:36.571995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 567/1136] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:36.842154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a483a33-4d48-42f0-a4b4-ef4d564d3dbb None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:36.904048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:36.941948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a483a33-4d48-42f0-a4b4-ef4d564d3dbb None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:36.976757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286316c4-ff0c-49a3-8358-65334f6b1ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:36.977389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286316c4-ff0c-49a3-8358-65334f6b1ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:36.977670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286316c4-ff0c-49a3-8358-65334f6b1ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:36.977945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286316c4-ff0c-49a3-8358-65334f6b1ed8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:36.979092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286316c4-ff0c-49a3-8358-65334f6b1ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:36.980592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286316c4-ff0c-49a3-8358-65334f6b1ed8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:36.982170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 570/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:36.988141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef8050-17eb-4ab7-a2fc-a2e2398e69bd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:37.049691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:37.089328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef8050-17eb-4ab7-a2fc-a2e2398e69bd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:37.125612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55626a1-9b2b-4313-a96e-b3c6a42b5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:37.126137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55626a1-9b2b-4313-a96e-b3c6a42b5f7c None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:37.126417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55626a1-9b2b-4313-a96e-b3c6a42b5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:37.126688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55626a1-9b2b-4313-a96e-b3c6a42b5f7c None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:37.127347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55626a1-9b2b-4313-a96e-b3c6a42b5f7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:37.128805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55626a1-9b2b-4313-a96e-b3c6a42b5f7c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:37.211716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 568/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:35:36 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:35:39.232326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608827-5a28-49e9-8346-8a49496c9bb8 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:39.232890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608827-5a28-49e9-8346-8a49496c9bb8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:39.232890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608827-5a28-49e9-8346-8a49496c9bb8 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:39.234200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 571/1139] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:39.239473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220584-ec70-4135-854b-99698c55ace7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:39.240540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220584-ec70-4135-854b-99698c55ace7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:39.240642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220584-ec70-4135-854b-99698c55ace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:39.258294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-08220584-ec70-4135-854b-99698c55ace7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:39.259532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-08220584-ec70-4135-854b-99698c55ace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:39.325884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 569/1140] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:39.601719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6608827-5a28-49e9-8346-8a49496c9bb8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:39.701367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6608827-5a28-49e9-8346-8a49496c9bb8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:39.729767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:39.735302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:39.735957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:39.736240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:39.736514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:39.746568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:39.751265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:39.752385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:39.753252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 572/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:39.759667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220584-ec70-4135-854b-99698c55ace7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:39.807291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:39.858549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220584-ec70-4135-854b-99698c55ace7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:39.910858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:39.911486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:39.911766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:39.912035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:39.912702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:39.913001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:39.914363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:39.922937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 570/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:39.928850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:40.029661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0958-b1d6-4a80-9a40-c8b554b909ee None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:40.062304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:40.062936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.063218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.063524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] PATH_INFO: `/v3/users/d9e03cc711eb4c7081b98e5cd0f6efa3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.077652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=d9e03cc711eb4c7081b98e5cd0f6efa3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:40.079115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:40.080823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 573/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:39 2022] GET /identity/v3/users/d9e03cc711eb4c7081b98e5cd0f6efa3 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:40.087388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:40.183930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121542-3f07-436d-a7c4-7f4f015368ed None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:40.195835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:40.219689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:40.220303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.220582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.220861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.287879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:40.289351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:40.395771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 571/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:40.401722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:40.450056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:40.503384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4693f4e-68b5-4975-82f4-4eecfc4bf2d9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:40.542552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd2977-ef71-467b-a06d-63fdda6253d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:40.543198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd2977-ef71-467b-a06d-63fdda6253d8 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.543517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd2977-ef71-467b-a06d-63fdda6253d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.543797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd2977-ef71-467b-a06d-63fdda6253d8 None admin] PATH_INFO: `/v3/projects/2b5042fc75dc402dafce7eb2316c9690` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.544974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd2977-ef71-467b-a06d-63fdda6253d8 None admin] RBAC: Authorizing `identity:get_project(project_id=2b5042fc75dc402dafce7eb2316c9690)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:40.546438 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd2977-ef71-467b-a06d-63fdda6253d8 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:40.548146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 574/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:40 2022] GET /identity/v3/projects/2b5042fc75dc402dafce7eb2316c9690 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:40.556957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:40.572016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:40.662073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e8d0-efb1-435e-9ff1-5c07bbe51b46 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:40.695965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7f893-2809-40b2-a891-f0e1c652cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:40.696565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7f893-2809-40b2-a891-f0e1c652cb16 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:40.696846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7f893-2809-40b2-a891-f0e1c652cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:40.697120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7f893-2809-40b2-a891-f0e1c652cb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:40.697852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7f893-2809-40b2-a891-f0e1c652cb16 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=2b5042fc75dc402dafce7eb2316c9690, user.id=d9e03cc711eb4c7081b98e5cd0f6efa3) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:40.698162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7f893-2809-40b2-a891-f0e1c652cb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:40.699609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7f893-2809-40b2-a891-f0e1c652cb16 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:40.704957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 572/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:40 2022] GET /identity/v3/role_assignments?user.id=d9e03cc711eb4c7081b98e5cd0f6efa3&scope.project.id=2b5042fc75dc402dafce7eb2316c9690&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:42.560167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc4837-6535-47b9-bce6-fb17ca3e4752 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.560713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc4837-6535-47b9-bce6-fb17ca3e4752 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.560713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc4837-6535-47b9-bce6-fb17ca3e4752 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.562060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 575/1147] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:42.567402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916f91-4728-4ec0-b02a-455b1ad5bab9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:42.567897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916f91-4728-4ec0-b02a-455b1ad5bab9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:42.567998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916f91-4728-4ec0-b02a-455b1ad5bab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:42.586148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-79916f91-4728-4ec0-b02a-455b1ad5bab9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:42.587353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-79916f91-4728-4ec0-b02a-455b1ad5bab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:42.653448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 573/1148] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:42.923672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc4837-6535-47b9-bce6-fb17ca3e4752 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:43.024051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc4837-6535-47b9-bce6-fb17ca3e4752 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:43.040403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:43.057493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:43.063696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.063696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.063696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.069654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:43.074350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:43.075488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:43.076505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:43.079707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 576/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:43.081617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916f91-4728-4ec0-b02a-455b1ad5bab9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:43.085322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:43.181707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916f91-4728-4ec0-b02a-455b1ad5bab9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:43.215117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:43.215754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.216037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.216309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.216986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:43.217291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:43.218649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:43.226714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 574/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:43.232646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:43.332737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009c9ea-235e-4a68-92fb-d2aa028f7b88 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:43.371552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:43.372170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.372446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.372714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] PATH_INFO: `/v3/users/d9e03cc711eb4c7081b98e5cd0f6efa3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.373840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] RBAC: Authorizing `identity:get_user(user_id=d9e03cc711eb4c7081b98e5cd0f6efa3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:43.375258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:43.376872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 577/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:43 2022] GET /identity/v3/users/d9e03cc711eb4c7081b98e5cd0f6efa3 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:43.383356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:43.455124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:43.492104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833bdfd-788a-48de-aa15-7d6d80fb5698 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:43.525883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d18e0-0f15-4f2d-84a9-413a4538160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:43.526513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d18e0-0f15-4f2d-84a9-413a4538160f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.526797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d18e0-0f15-4f2d-84a9-413a4538160f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.527072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d18e0-0f15-4f2d-84a9-413a4538160f None admin] PATH_INFO: `/v3/projects/2b5042fc75dc402dafce7eb2316c9690` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.528241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d18e0-0f15-4f2d-84a9-413a4538160f None admin] RBAC: Authorizing `identity:get_project(project_id=2b5042fc75dc402dafce7eb2316c9690)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:43.529677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d18e0-0f15-4f2d-84a9-413a4538160f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:43.531348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 575/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:43 2022] GET /identity/v3/projects/2b5042fc75dc402dafce7eb2316c9690 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:43.537961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:43.584918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:43.642115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87a82-a107-4e59-8f58-187ac06ae03a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:43.682622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31128-2c96-4035-99f6-59f4b10d12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:43.683286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31128-2c96-4035-99f6-59f4b10d12d4 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:43.683597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31128-2c96-4035-99f6-59f4b10d12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:43.683873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31128-2c96-4035-99f6-59f4b10d12d4 None admin] PATH_INFO: `/v3/projects/2b5042fc75dc402dafce7eb2316c9690/users/d9e03cc711eb4c7081b98e5cd0f6efa3/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:43.685779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb31128-2c96-4035-99f6-59f4b10d12d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5042fc75dc402dafce7eb2316c9690, user_id=d9e03cc711eb4c7081b98e5cd0f6efa3, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:43.687218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb31128-2c96-4035-99f6-59f4b10d12d4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:43.754621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 578/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:35:43 2022] PUT /identity/v3/projects/2b5042fc75dc402dafce7eb2316c9690/users/d9e03cc711eb4c7081b98e5cd0f6efa3/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:35:45.633201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee5bc-2f9f-4dbf-b483-b16577258112 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.633717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee5bc-2f9f-4dbf-b483-b16577258112 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.633717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee5bc-2f9f-4dbf-b483-b16577258112 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.635004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 576/1154] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:45.640353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305512-29d6-4895-8408-5582eff0a36c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:45.640779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305512-29d6-4895-8408-5582eff0a36c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:45.640907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305512-29d6-4895-8408-5582eff0a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:45.659113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-65305512-29d6-4895-8408-5582eff0a36c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:45.660335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-65305512-29d6-4895-8408-5582eff0a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:45.725522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 579/1155] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:45.992839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee5bc-2f9f-4dbf-b483-b16577258112 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.094687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee5bc-2f9f-4dbf-b483-b16577258112 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.129023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.129649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.129955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.130761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.132649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.141604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:35:46.147098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:46.150172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:35:46.151216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 577/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:35:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:46.154294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305512-29d6-4895-8408-5582eff0a36c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.188003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.253382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305512-29d6-4895-8408-5582eff0a36c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.291273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.291923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.292206 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.292483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.293155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:46.293464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.294834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.303592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 580/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:46.309513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.407485 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed80adc-cd08-4c26-8f43-5d4bf77b7c27 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.440438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.441072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.441349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.441615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] PATH_INFO: `/v3/users/d9e03cc711eb4c7081b98e5cd0f6efa3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.443284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] RBAC: Authorizing `identity:get_user(user_id=d9e03cc711eb4c7081b98e5cd0f6efa3)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.444737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.446310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 578/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/users/d9e03cc711eb4c7081b98e5cd0f6efa3 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:46.452302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.546133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.551662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8349e8-9163-4343-9b3a-601eeb071c7f None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.590669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.591275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.591590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.591865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.657688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.659139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.754457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.761768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 581/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:46.769117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:46.830503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:46.870270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cb21d-f6c9-4176-9e6a-0f474e1e889c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:46.904945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00a743-ef76-4ae3-90b2-1b5c10515710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:46.905580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00a743-ef76-4ae3-90b2-1b5c10515710 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:46.905862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00a743-ef76-4ae3-90b2-1b5c10515710 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:46.906143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00a743-ef76-4ae3-90b2-1b5c10515710 None admin] PATH_INFO: `/v3/projects/2b5042fc75dc402dafce7eb2316c9690` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:46.907260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00a743-ef76-4ae3-90b2-1b5c10515710 None admin] RBAC: Authorizing `identity:get_project(project_id=2b5042fc75dc402dafce7eb2316c9690)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:46.908726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00a743-ef76-4ae3-90b2-1b5c10515710 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:46.910364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 579/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/projects/2b5042fc75dc402dafce7eb2316c9690 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:46.916567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:47.016344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad857-c9d3-4f24-b456-39edbef0dbe9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:47.049382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2359c64-bc76-4dcf-ac6e-5d0cda528564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:47.049981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2359c64-bc76-4dcf-ac6e-5d0cda528564 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:47.050263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2359c64-bc76-4dcf-ac6e-5d0cda528564 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:47.050536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2359c64-bc76-4dcf-ac6e-5d0cda528564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:47.051258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2359c64-bc76-4dcf-ac6e-5d0cda528564 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=2b5042fc75dc402dafce7eb2316c9690, user.id=d9e03cc711eb4c7081b98e5cd0f6efa3) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:47.051601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2359c64-bc76-4dcf-ac6e-5d0cda528564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:47.053555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2359c64-bc76-4dcf-ac6e-5d0cda528564 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:47.059256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 582/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:35:46 2022] GET /identity/v3/role_assignments?user.id=d9e03cc711eb4c7081b98e5cd0f6efa3&scope.project.id=2b5042fc75dc402dafce7eb2316c9690&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:48.994130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403d0d3-3249-4657-9fa3-d92cdecb6a7b None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:48.994666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403d0d3-3249-4657-9fa3-d92cdecb6a7b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:48.994666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403d0d3-3249-4657-9fa3-d92cdecb6a7b None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:48.996031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 580/1162] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:49.001160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b279c-2937-4edd-af40-f75238fd6247 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:49.001555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b279c-2937-4edd-af40-f75238fd6247 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:49.001712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b279c-2937-4edd-af40-f75238fd6247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:49.019620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d35b279c-2937-4edd-af40-f75238fd6247 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:49.020840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d35b279c-2937-4edd-af40-f75238fd6247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:49.073894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:49.085195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 583/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:49.350600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403d0d3-3249-4657-9fa3-d92cdecb6a7b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:49.450486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403d0d3-3249-4657-9fa3-d92cdecb6a7b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:49.478430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:49.484027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:49.484635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:49.484917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:49.485194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:49.556561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:49.558023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:49.658212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 581/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:35:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:35:49.664168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b279c-2937-4edd-af40-f75238fd6247 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:49.760619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b279c-2937-4edd-af40-f75238fd6247 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:49.793726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1376-937d-4e0e-a128-f76c055ffa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:49.794351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1376-937d-4e0e-a128-f76c055ffa17 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:49.794629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1376-937d-4e0e-a128-f76c055ffa17 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:49.794899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1376-937d-4e0e-a128-f76c055ffa17 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:49.801368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d1376-937d-4e0e-a128-f76c055ffa17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:49.802837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d1376-937d-4e0e-a128-f76c055ffa17 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-fd6d1376-937d-4e0e-a128-f76c055ffa17 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:35:49.813914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:35:49.815103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:35:49.816049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 584/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:35:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:35:49.821633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:49.851013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:49.922851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d55dc-d7bf-43f4-b63e-dc4f7889b8fa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:49.956467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd835e6-1713-4d45-9611-025d4ba6e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:49.957073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd835e6-1713-4d45-9611-025d4ba6e9dd None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:49.957355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd835e6-1713-4d45-9611-025d4ba6e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:49.957627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd835e6-1713-4d45-9611-025d4ba6e9dd None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:49.958304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd835e6-1713-4d45-9611-025d4ba6e9dd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:35:49.958608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd835e6-1713-4d45-9611-025d4ba6e9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:49.959999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd835e6-1713-4d45-9611-025d4ba6e9dd None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:49.966920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 582/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Aug 18 20:35:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:51.868787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8500d-658e-496d-914d-df5dcd90935e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.869371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8500d-658e-496d-914d-df5dcd90935e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.869371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8500d-658e-496d-914d-df5dcd90935e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.870654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 585/1167] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:51.875987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae311da-d315-4caa-ba48-ad742f53c7c0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:51.876417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae311da-d315-4caa-ba48-ad742f53c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:51.876551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae311da-d315-4caa-ba48-ad742f53c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:51.894937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-dae311da-d315-4caa-ba48-ad742f53c7c0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:51.896806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-dae311da-d315-4caa-ba48-ad742f53c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:51.962568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 583/1168] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:52.226492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8500d-658e-496d-914d-df5dcd90935e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:52.283319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:52.337917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8500d-658e-496d-914d-df5dcd90935e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:52.372907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118175f-badb-4027-98d2-dd10ad2adf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:52.373506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118175f-badb-4027-98d2-dd10ad2adf1f None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:52.373789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118175f-badb-4027-98d2-dd10ad2adf1f None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:52.374064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118175f-badb-4027-98d2-dd10ad2adf1f None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:52.374775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118175f-badb-4027-98d2-dd10ad2adf1f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:52.376189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118175f-badb-4027-98d2-dd10ad2adf1f None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:52.452520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 586/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Thu Aug 18 20:35:52 2022] POST /identity/v3/domains => generated 267 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:54.425186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709d663-6ae0-467c-b487-21086d32fcb1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:54.425736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709d663-6ae0-467c-b487-21086d32fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:54.425736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709d663-6ae0-467c-b487-21086d32fcb1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:54.427092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 584/1170] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:54.432319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b6cf-cee4-4a2a-9779-e956b1daee28 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:54.432726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b6cf-cee4-4a2a-9779-e956b1daee28 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:54.432860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b6cf-cee4-4a2a-9779-e956b1daee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:54.450354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d190b6cf-cee4-4a2a-9779-e956b1daee28 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:54.451569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d190b6cf-cee4-4a2a-9779-e956b1daee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:54.516752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 587/1171] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:54.786179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709d663-6ae0-467c-b487-21086d32fcb1 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:54.811938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:54.890001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709d663-6ae0-467c-b487-21086d32fcb1 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:54.923525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001f5b-de99-446d-a7b4-ad50351b7904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:54.924158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f5b-de99-446d-a7b4-ad50351b7904 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:54.924442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f5b-de99-446d-a7b4-ad50351b7904 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:54.924717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f5b-de99-446d-a7b4-ad50351b7904 None admin] PATH_INFO: `/v3/domains/13d499c0ea0f411eb9fa3bc61db55adf` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:54.935132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f5b-de99-446d-a7b4-ad50351b7904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=13d499c0ea0f411eb9fa3bc61db55adf)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:54.936611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f5b-de99-446d-a7b4-ad50351b7904 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:54.938228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 585/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Thu Aug 18 20:35:54 2022] GET /identity/v3/domains/13d499c0ea0f411eb9fa3bc61db55adf => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:54.944665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b6cf-cee4-4a2a-9779-e956b1daee28 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:54.985465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:55.043812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b6cf-cee4-4a2a-9779-e956b1daee28 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:55.077140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6a330-3753-4353-851a-74c208d207e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:55.077741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6a330-3753-4353-851a-74c208d207e5 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:55.078020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6a330-3753-4353-851a-74c208d207e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:55.078291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6a330-3753-4353-851a-74c208d207e5 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:55.078959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6a330-3753-4353-851a-74c208d207e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:55.080413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6a330-3753-4353-851a-74c208d207e5 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:55.189260 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 588/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:35:54 2022] POST /identity/v3/projects => generated 361 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:57.142732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05564870-0f79-48ce-be0e-68ab5d747331 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.143295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05564870-0f79-48ce-be0e-68ab5d747331 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.143295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05564870-0f79-48ce-be0e-68ab5d747331 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.144646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 586/1174] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:57.150429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799ad87-3ec9-41e3-92f3-6c66b6206ce4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.150809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799ad87-3ec9-41e3-92f3-6c66b6206ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.150987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799ad87-3ec9-41e3-92f3-6c66b6206ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.168854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a799ad87-3ec9-41e3-92f3-6c66b6206ce4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:57.170049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a799ad87-3ec9-41e3-92f3-6c66b6206ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:35:57.240489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 589/1175] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:35:57.509840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05564870-0f79-48ce-be0e-68ab5d747331 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:57.593758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:57.611242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05564870-0f79-48ce-be0e-68ab5d747331 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:57.645523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86af1d-3273-437d-8f74-b7e27cdd67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:57.646143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86af1d-3273-437d-8f74-b7e27cdd67d5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.646424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86af1d-3273-437d-8f74-b7e27cdd67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.646698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86af1d-3273-437d-8f74-b7e27cdd67d5 None admin] PATH_INFO: `/v3/domains/13d499c0ea0f411eb9fa3bc61db55adf` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.647827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86af1d-3273-437d-8f74-b7e27cdd67d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=13d499c0ea0f411eb9fa3bc61db55adf)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:57.649248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86af1d-3273-437d-8f74-b7e27cdd67d5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:57.650801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 587/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Thu Aug 18 20:35:57 2022] GET /identity/v3/domains/13d499c0ea0f411eb9fa3bc61db55adf => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:35:57.656675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799ad87-3ec9-41e3-92f3-6c66b6206ce4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:35:57.679970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:35:57.752728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799ad87-3ec9-41e3-92f3-6c66b6206ce4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:35:57.785499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cf29a-7fa4-41f3-ba6b-27eb2a4f33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:35:57.786561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cf29a-7fa4-41f3-ba6b-27eb2a4f33a4 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:57.786838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cf29a-7fa4-41f3-ba6b-27eb2a4f33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:57.787108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cf29a-7fa4-41f3-ba6b-27eb2a4f33a4 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:57.787811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cf29a-7fa4-41f3-ba6b-27eb2a4f33a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:35:57.796875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cf29a-7fa4-41f3-ba6b-27eb2a4f33a4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:35:57.884172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 590/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:35:57 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:35:59.910298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9eac-eb6a-4014-a3da-fcc9162324cd None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:59.910866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9eac-eb6a-4014-a3da-fcc9162324cd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:59.910866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9eac-eb6a-4014-a3da-fcc9162324cd None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:59.912770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 588/1178] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:35:59.918006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997ffb0-da54-4a34-b617-87797be04b7e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:35:59.918411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997ffb0-da54-4a34-b617-87797be04b7e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:35:59.918555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997ffb0-da54-4a34-b617-87797be04b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:35:59.937046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8997ffb0-da54-4a34-b617-87797be04b7e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:35:59.938234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8997ffb0-da54-4a34-b617-87797be04b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:00.006405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 591/1179] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:35:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:00.272436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9eac-eb6a-4014-a3da-fcc9162324cd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.382708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9eac-eb6a-4014-a3da-fcc9162324cd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.416662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.417292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.417574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.417850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.428390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:00.434257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:00.435573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:36:00.436867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 589/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:00.444169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997ffb0-da54-4a34-b617-87797be04b7e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.458378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:00.544586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997ffb0-da54-4a34-b617-87797be04b7e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.579663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.580270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.580551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.580824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.581493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:00.581799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:00.583161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:00.591058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 592/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:00.596867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.611978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:00.696566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa8ec-18aa-4e99-a144-0250851c7508 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.729872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.730503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.730783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.731057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] PATH_INFO: `/v3/users/143dda5a5c2045fb984ac0900f20f0b2` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.745218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] RBAC: Authorizing `identity:get_user(user_id=143dda5a5c2045fb984ac0900f20f0b2)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:00.746668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:00.748307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 590/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:00 2022] GET /identity/v3/users/143dda5a5c2045fb984ac0900f20f0b2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:00.754349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:00.822905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:00.853898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb73d-5af9-4646-97df-47a8a42ddc90 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:00.887649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:00.888243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:00.888524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:00.888798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:00.953682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:00.955127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:01.019480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:01.049968 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 593/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:01.055187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:01.123839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:01.154090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787b765-84b5-45e6-a675-7c3b9962d142 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:01.186128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132eb46-e857-4b96-8797-8f1e35c5e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:01.186741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132eb46-e857-4b96-8797-8f1e35c5e444 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:01.187017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132eb46-e857-4b96-8797-8f1e35c5e444 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:01.187286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132eb46-e857-4b96-8797-8f1e35c5e444 None admin] PATH_INFO: `/v3/projects/8e9b6616e77147f9a8909ce110bfce55` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:01.188410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132eb46-e857-4b96-8797-8f1e35c5e444 None admin] RBAC: Authorizing `identity:get_project(project_id=8e9b6616e77147f9a8909ce110bfce55)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:01.189827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132eb46-e857-4b96-8797-8f1e35c5e444 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:01.191451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 591/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:01 2022] GET /identity/v3/projects/8e9b6616e77147f9a8909ce110bfce55 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:01.198155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:01.292267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f374fc-fc8f-48ba-9761-b58ce91df30a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:01.325752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d76f4-82c1-460c-bbdd-2cd83b74958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:01.326349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d76f4-82c1-460c-bbdd-2cd83b74958d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:01.326629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d76f4-82c1-460c-bbdd-2cd83b74958d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:01.326897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d76f4-82c1-460c-bbdd-2cd83b74958d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:01.327648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d76f4-82c1-460c-bbdd-2cd83b74958d None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=8e9b6616e77147f9a8909ce110bfce55, user.id=143dda5a5c2045fb984ac0900f20f0b2) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:01.327951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d76f4-82c1-460c-bbdd-2cd83b74958d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:01.329357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d76f4-82c1-460c-bbdd-2cd83b74958d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:01.334674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 594/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:36:01 2022] GET /identity/v3/role_assignments?user.id=143dda5a5c2045fb984ac0900f20f0b2&scope.project.id=8e9b6616e77147f9a8909ce110bfce55&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:03.205943 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da545b6-b406-4ae6-887f-e0446c8511e0 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.206512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da545b6-b406-4ae6-887f-e0446c8511e0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.206512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da545b6-b406-4ae6-887f-e0446c8511e0 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.207901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 592/1186] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:03.213178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229703da-b726-4aa4-8515-c6a87b0aa4bc None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.213949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229703da-b726-4aa4-8515-c6a87b0aa4bc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.214222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229703da-b726-4aa4-8515-c6a87b0aa4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.232441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-229703da-b726-4aa4-8515-c6a87b0aa4bc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:03.233648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-229703da-b726-4aa4-8515-c6a87b0aa4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:03.259501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:03.298655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 595/1187] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:03.574663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da545b6-b406-4ae6-887f-e0446c8511e0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.686508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da545b6-b406-4ae6-887f-e0446c8511e0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:03.723410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:03.724044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.724324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.724598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.731493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:03.735452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:03.740797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:03.745548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:36:03.746600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 593/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:03.748059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229703da-b726-4aa4-8515-c6a87b0aa4bc None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.845450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229703da-b726-4aa4-8515-c6a87b0aa4bc None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:03.878602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:03.879742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:03.880017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:03.880284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:03.880944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:03.881243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:03.882599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:03.890858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 596/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:03.897329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:03.994895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44a237-ebfd-4911-bd23-218b6c6b99fa None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:04.029029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:04.029663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:04.029949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:04.030229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] PATH_INFO: `/v3/users/143dda5a5c2045fb984ac0900f20f0b2` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:04.031448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] RBAC: Authorizing `identity:get_user(user_id=143dda5a5c2045fb984ac0900f20f0b2)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:04.032823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:04.034430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 594/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:03 2022] GET /identity/v3/users/143dda5a5c2045fb984ac0900f20f0b2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:04.040229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:04.068314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:04.139918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c837cc-9672-4d98-88f9-d78c435f3da7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:04.171940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07205-bdb4-4eea-9c19-66e0fa258294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:04.172562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07205-bdb4-4eea-9c19-66e0fa258294 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:04.172843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07205-bdb4-4eea-9c19-66e0fa258294 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:04.173115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07205-bdb4-4eea-9c19-66e0fa258294 None admin] PATH_INFO: `/v3/projects/8e9b6616e77147f9a8909ce110bfce55` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:04.174232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce07205-bdb4-4eea-9c19-66e0fa258294 None admin] RBAC: Authorizing `identity:get_project(project_id=8e9b6616e77147f9a8909ce110bfce55)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:04.175688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce07205-bdb4-4eea-9c19-66e0fa258294 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:04.177859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 597/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:04 2022] GET /identity/v3/projects/8e9b6616e77147f9a8909ce110bfce55 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:04.184030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:04.248617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:04.284114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f589c7-ec06-4487-8865-981d25823c0e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:04.318751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f67ed-24d7-4aac-9752-67cee038d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:04.319439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f67ed-24d7-4aac-9752-67cee038d7d6 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:04.319721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f67ed-24d7-4aac-9752-67cee038d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:04.319995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f67ed-24d7-4aac-9752-67cee038d7d6 None admin] PATH_INFO: `/v3/projects/8e9b6616e77147f9a8909ce110bfce55/users/143dda5a5c2045fb984ac0900f20f0b2/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:04.321884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f67ed-24d7-4aac-9752-67cee038d7d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e9b6616e77147f9a8909ce110bfce55, user_id=143dda5a5c2045fb984ac0900f20f0b2, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:04.323308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f67ed-24d7-4aac-9752-67cee038d7d6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:04.404992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 595/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:36:04 2022] PUT /identity/v3/projects/8e9b6616e77147f9a8909ce110bfce55/users/143dda5a5c2045fb984ac0900f20f0b2/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:36:06.261457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbc1f-550e-4014-9822-69b789f99f89 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:06.262027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbc1f-550e-4014-9822-69b789f99f89 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:06.262027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbc1f-550e-4014-9822-69b789f99f89 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:06.263384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 598/1193] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:36:06.268471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1e66-4fe0-478f-8568-2c32e2c4afd5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:06.268886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1e66-4fe0-478f-8568-2c32e2c4afd5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:06.269028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1e66-4fe0-478f-8568-2c32e2c4afd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:06.287659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3e6d1e66-4fe0-478f-8568-2c32e2c4afd5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:36:06.288851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3e6d1e66-4fe0-478f-8568-2c32e2c4afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:36:06.354697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 596/1194] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:36:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:36:06.624376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cbc1f-550e-4014-9822-69b789f99f89 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:06.723998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:06.731937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cbc1f-550e-4014-9822-69b789f99f89 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:06.767788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:06.768517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:06.768796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:06.769074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:06.779548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:36:06.784235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:36:06.785913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:36:06.786956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 599/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:36:06.792198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d1e66-4fe0-478f-8568-2c32e2c4afd5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:06.847109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:06.890683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d1e66-4fe0-478f-8568-2c32e2c4afd5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:06.924115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:06.924720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:06.925033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:06.925310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:06.926565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:06.926872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:06.928269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:06.936182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 597/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:36:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:06.942132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:07.039820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38377048-4f81-4add-9af7-8d5032166e90 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:07.072603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:07.073238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:07.073517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:07.073789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] PATH_INFO: `/v3/users/143dda5a5c2045fb984ac0900f20f0b2` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:07.074996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] RBAC: Authorizing `identity:get_user(user_id=143dda5a5c2045fb984ac0900f20f0b2)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:07.076519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:07.078189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 600/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Aug 18 20:36:06 2022] GET /identity/v3/users/143dda5a5c2045fb984ac0900f20f0b2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:07.085153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:07.186867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5623-7eb2-4e3d-8b97-123f066fb442 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:07.203155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:07.219791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:07.220404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:07.220687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:07.220962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:07.287739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:07.289195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:07.386830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 598/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:36:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:36:07.392962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:07.417985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:07.491495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5995-d031-4b5f-9a28-06762345eb4d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:07.527681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a2fd3-3e5e-4a1c-ad99-aa89db953316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:07.528315 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2fd3-3e5e-4a1c-ad99-aa89db953316 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:07.528592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2fd3-3e5e-4a1c-ad99-aa89db953316 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:07.528863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2fd3-3e5e-4a1c-ad99-aa89db953316 None admin] PATH_INFO: `/v3/projects/8e9b6616e77147f9a8909ce110bfce55` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:07.530013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2fd3-3e5e-4a1c-ad99-aa89db953316 None admin] RBAC: Authorizing `identity:get_project(project_id=8e9b6616e77147f9a8909ce110bfce55)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:07.531503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2fd3-3e5e-4a1c-ad99-aa89db953316 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:07.533178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 601/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Aug 18 20:36:07 2022] GET /identity/v3/projects/8e9b6616e77147f9a8909ce110bfce55 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:07.539328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:36:07.558171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:07.638460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386d205-b993-419d-9239-a1f20a28e71a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:36:07.672316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaedca8-232e-4ccd-9f48-a514ed9281e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:36:07.672915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaedca8-232e-4ccd-9f48-a514ed9281e1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:36:07.673193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaedca8-232e-4ccd-9f48-a514ed9281e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:36:07.673460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaedca8-232e-4ccd-9f48-a514ed9281e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:36:07.674186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaedca8-232e-4ccd-9f48-a514ed9281e1 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=8e9b6616e77147f9a8909ce110bfce55, user.id=143dda5a5c2045fb984ac0900f20f0b2) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:36:07.674494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaedca8-232e-4ccd-9f48-a514ed9281e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:36:07.675962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaedca8-232e-4ccd-9f48-a514ed9281e1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:36:07.681883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 599/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:36:07 2022] GET /identity/v3/role_assignments?user.id=143dda5a5c2045fb984ac0900f20f0b2&scope.project.id=8e9b6616e77147f9a8909ce110bfce55&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:36:17.523328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=55 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:36:17.679160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=59 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:20.236335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d611b4-a0c9-47df-9620-7237657a75bd None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:20.236934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d611b4-a0c9-47df-9620-7237657a75bd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:20.236934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d611b4-a0c9-47df-9620-7237657a75bd None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:20.238340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 602/1201] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:20.243949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047a859-17e2-48fc-8957-ad25587d0d87 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:20.247801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047a859-17e2-48fc-8957-ad25587d0d87 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:20.247801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047a859-17e2-48fc-8957-ad25587d0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:20.265187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1047a859-17e2-48fc-8957-ad25587d0d87 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:20.266480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1047a859-17e2-48fc-8957-ad25587d0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:20.337378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 600/1202] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:20.624279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d611b4-a0c9-47df-9620-7237657a75bd None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:20.723470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d611b4-a0c9-47df-9620-7237657a75bd None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:20.756386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:20.757000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:20.757273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:20.757539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:20.767480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:20.768918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:20.783725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:20.784974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:20.785943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:20.785943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:20.785943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:20.785943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 603/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:20.791574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047a859-17e2-48fc-8957-ad25587d0d87 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:20.887618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047a859-17e2-48fc-8957-ad25587d0d87 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:20.915287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:20.920905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add902d-835b-41dd-9452-282387cf8003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:20.921500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add902d-835b-41dd-9452-282387cf8003 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:20.921779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add902d-835b-41dd-9452-282387cf8003 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:20.922052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add902d-835b-41dd-9452-282387cf8003 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:20.922688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add902d-835b-41dd-9452-282387cf8003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:20.922989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add902d-835b-41dd-9452-282387cf8003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:20.924381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add902d-835b-41dd-9452-282387cf8003 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:20.935410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 601/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:20.941459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:20.995647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:21.042693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51341b24-09a5-4f3d-97b5-de8dfda4eb4d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:21.074953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3492693-3f2a-4f9d-9b18-8b2e7d36f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:21.075568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3492693-3f2a-4f9d-9b18-8b2e7d36f9cd None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:21.075851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3492693-3f2a-4f9d-9b18-8b2e7d36f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:21.076123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3492693-3f2a-4f9d-9b18-8b2e7d36f9cd None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:21.076751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3492693-3f2a-4f9d-9b18-8b2e7d36f9cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:21.078176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3492693-3f2a-4f9d-9b18-8b2e7d36f9cd None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:21.166396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 604/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Aug 18 20:37:20 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:37:23.090187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb513dd-3036-4840-97b4-3da6e4598262 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:23.090768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb513dd-3036-4840-97b4-3da6e4598262 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:23.090768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb513dd-3036-4840-97b4-3da6e4598262 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:23.092141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 602/1206] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:23.097173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f5d3-7d58-422f-9ceb-949455b8fa0e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:23.097599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f5d3-7d58-422f-9ceb-949455b8fa0e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:23.097732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f5d3-7d58-422f-9ceb-949455b8fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:23.116529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e584f5d3-7d58-422f-9ceb-949455b8fa0e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:23.118740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e584f5d3-7d58-422f-9ceb-949455b8fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:23.183963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 605/1207] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:23.450260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb513dd-3036-4840-97b4-3da6e4598262 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:23.553964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb513dd-3036-4840-97b4-3da6e4598262 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:23.587531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:23.588156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:23.588429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:23.588697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:23.598452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:23.603701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:23.606736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:23.607878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 603/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:23.610861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f5d3-7d58-422f-9ceb-949455b8fa0e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:23.649752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:23.715269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f5d3-7d58-422f-9ceb-949455b8fa0e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:23.749360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:23.749952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:23.750229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:23.750496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:23.751151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:23.751525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:23.755433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:23.760981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 606/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:37:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:23.766740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:23.824946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:23.873179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768fe94-7aac-485e-9daa-86e2c658b9e5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:23.910280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:23.911019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:23.911304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:23.911617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:23.922246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:23.923723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:23.937992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:23.939177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:23.940308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:23.940308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:23.940308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:23.940308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 604/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:23.945578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:24.043172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:24.046008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8355-b963-4445-9860-f1bb0c222ed2 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:24.078985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:24.079665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:24.082597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:24.082597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:24.082597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:24.082597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:24.082597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:24.094565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 607/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:24.100298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:24.204138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56b42-f8cc-4e67-a557-04613063cffb None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:24.205512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:24.236509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:24.237196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:24.237473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:24.237739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:24.245634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:24.247058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:24.258575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:24.259994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:24.261471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 605/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:24.265768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:24.364584 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22b225-cfa8-4c67-abe3-96b3a1feb20d None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:24.398772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:24.399380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:24.399692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:24.400063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:24.400792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:24.401097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:24.402524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:24.419047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 608/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:24.424770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:24.528929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867df3d-62fc-45c3-85c4-2958ff70908d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:24.567945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:24.569136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:24.569420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:24.569693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:24.599045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:24.636148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:24.637590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:24.738379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 606/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:37:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:37:24.744792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:24.763597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:24.839906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce1a0b-d7ff-46af-b908-5d55672ffef7 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:24.874461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:24.875076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:24.875372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:24.875665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:24.885759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:24.887188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:24.901283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:24.902442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:24.903591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:24.903591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:24.903591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:24.903591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 609/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:24.908425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:24.970176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:25.008051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3015d-3460-4a90-a1ca-d5a6615f1764 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:25.041903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:25.042507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:25.042788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:25.043061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:25.043738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:25.044047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:25.045405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:25.057170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 607/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:25.062837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:25.132019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:25.163416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1947e-aaf6-45a5-a770-43c1d4705281 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:25.198818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:25.199478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:25.199758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:25.200028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:25.206661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:25.208120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:25.219543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:25.220626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:25.221772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 610/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:25.227060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:25.325879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2693-25a1-4a2f-be9b-0e791e9aaf57 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:25.351082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:25.362423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746daa0-2e90-4559-88b6-1abb79c5ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:25.364886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746daa0-2e90-4559-88b6-1abb79c5ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:25.364886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746daa0-2e90-4559-88b6-1abb79c5ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:25.364886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746daa0-2e90-4559-88b6-1abb79c5ebd1 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:25.364886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746daa0-2e90-4559-88b6-1abb79c5ebd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:25.364886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746daa0-2e90-4559-88b6-1abb79c5ebd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:25.365974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746daa0-2e90-4559-88b6-1abb79c5ebd1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:25.377105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 608/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:25.384209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:25.486365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e24a-41fd-4aec-adab-c3ed04ae6bec None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:25.514852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:25.520517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f314749-6e7a-453c-bf6a-ebfc0fcefb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:25.521108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f314749-6e7a-453c-bf6a-ebfc0fcefb37 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:25.521407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f314749-6e7a-453c-bf6a-ebfc0fcefb37 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:25.521652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f314749-6e7a-453c-bf6a-ebfc0fcefb37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:25.522366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f314749-6e7a-453c-bf6a-ebfc0fcefb37 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=4ee628c7459142eca1ebb60e1acfbeb0) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:25.522696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f314749-6e7a-453c-bf6a-ebfc0fcefb37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:25.524148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f314749-6e7a-453c-bf6a-ebfc0fcefb37 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:25.529374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 611/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:37:25 2022] GET /identity/v3/role_assignments?user.id=4ee628c7459142eca1ebb60e1acfbeb0&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:27.460702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2481c8-86a2-4313-a703-82834af034c7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:27.461223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2481c8-86a2-4313-a703-82834af034c7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:27.461316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2481c8-86a2-4313-a703-82834af034c7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:27.462648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 609/1220] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:27.467890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bade9e-1af0-4079-9701-91d2e200e79d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:27.468302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bade9e-1af0-4079-9701-91d2e200e79d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:27.468448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bade9e-1af0-4079-9701-91d2e200e79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:27.486093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-10bade9e-1af0-4079-9701-91d2e200e79d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:27.487345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-10bade9e-1af0-4079-9701-91d2e200e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:27.554453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 612/1221] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:27.822764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2481c8-86a2-4313-a703-82834af034c7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:27.926624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2481c8-86a2-4313-a703-82834af034c7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:27.960948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:27.961571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:27.961852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:27.962125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:27.971959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:27.976699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:27.979478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:27.980569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 610/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:37:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:27.983800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bade9e-1af0-4079-9701-91d2e200e79d None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:28.082391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bade9e-1af0-4079-9701-91d2e200e79d None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:28.106249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:28.116573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:28.117177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:28.117459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:28.117730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:28.118412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] RBAC: Adding query filter params (name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:28.118718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:28.120119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:28.127841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 613/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:37:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:28.133642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:28.178755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:28.242532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113205-5f73-4635-aaff-02849aba8d82 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:28.277063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:28.277693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:28.277977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:28.278255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:28.288683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:28.290119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:28.304453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:28.305535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:28.306443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:28.306443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:28.306443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:28.306443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 611/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:28.312008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:28.420637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47799b33-d419-42c3-83cf-8de980f0c420 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:28.453682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:28.454274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:28.454549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:28.454815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:28.455469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:28.455767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:28.457161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:28.469919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 614/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:28.476298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:28.571303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:28.577792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421513b4-9af4-463c-a066-c880c2ffe4e6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:28.622126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:28.622740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:28.623022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:28.623296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:28.630307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:28.632332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:28.644714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:28.648734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:28.650111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 612/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:28.652277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:28.698232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:28.749118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706f99b-b14a-45c4-9b30-93ccf8695342 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:28.783171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:28.783803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:28.784084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:28.784352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:28.785069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:28.785370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:28.786788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:28.803733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 615/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:28.809534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:28.921555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054235-6bb5-4a1d-8786-efd0d478d46a None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:28.955463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:28.956084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:28.956363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:28.956638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:28.966977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:28.968446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:28.982296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:28.983540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:28.984665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:28.984665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:28.984665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:28.984665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 613/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:28.989572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:29.086551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e04af-3574-46fd-adb7-9242d7f2cfeb None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:29.088953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:29.120648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:29.121246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:29.121521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:29.121788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:29.122422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:29.122719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:29.124102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:29.135291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 616/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:29.141201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:29.150703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:29.246930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d6d0-8b6f-4d26-a864-d80f2ce124a7 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:29.279836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:29.280469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:29.280753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:29.281029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:29.288001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:29.289467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:29.300344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:29.302047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:29.303704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 614/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:29.308171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:29.406994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65b8b-6e7b-49c0-9584-12f6fb24f4ea None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:29.440067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98e7aa-6be4-4838-be99-0958294db4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:29.440639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e7aa-6be4-4838-be99-0958294db4cb None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:29.440922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e7aa-6be4-4838-be99-0958294db4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:29.441195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e7aa-6be4-4838-be99-0958294db4cb None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:29.441878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98e7aa-6be4-4838-be99-0958294db4cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:29.442184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98e7aa-6be4-4838-be99-0958294db4cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:29.443632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98e7aa-6be4-4838-be99-0958294db4cb None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:29.455152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 617/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:29.461955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:29.544942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:29.581846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189ddf6-bbe9-4f80-8eda-76f405f9835c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:29.616839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec77cce-87ce-4902-8050-aded5b2166f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:29.617494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec77cce-87ce-4902-8050-aded5b2166f9 None admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:29.617777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec77cce-87ce-4902-8050-aded5b2166f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:29.618054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec77cce-87ce-4902-8050-aded5b2166f9 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/4ee628c7459142eca1ebb60e1acfbeb0/roles/79be860b24f44c24aa3d43cf616ffad8` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:29.631961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec77cce-87ce-4902-8050-aded5b2166f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=4ee628c7459142eca1ebb60e1acfbeb0, role_id=79be860b24f44c24aa3d43cf616ffad8)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:29.633544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec77cce-87ce-4902-8050-aded5b2166f9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:29.715855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 615/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:37:29 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/4ee628c7459142eca1ebb60e1acfbeb0/roles/79be860b24f44c24aa3d43cf616ffad8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:37:31.599514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8726ec-786c-489a-8538-239d32d3151f None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:31.600033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8726ec-786c-489a-8538-239d32d3151f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:31.600033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8726ec-786c-489a-8538-239d32d3151f None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:31.601513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 618/1233] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:31.607250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10e667-db26-4ccb-b234-e310a0d8d02b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:31.607711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10e667-db26-4ccb-b234-e310a0d8d02b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:31.607832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10e667-db26-4ccb-b234-e310a0d8d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:31.625480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5a10e667-db26-4ccb-b234-e310a0d8d02b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:31.626659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5a10e667-db26-4ccb-b234-e310a0d8d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:31.694417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 616/1234] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:31.968553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8726ec-786c-489a-8538-239d32d3151f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:31.994632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:32.070986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8726ec-786c-489a-8538-239d32d3151f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:32.105608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:32.106232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:32.106515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:32.106789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:32.117373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:32.122057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:32.123144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:32.124234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 619/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Aug 18 20:37:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:32.129392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10e667-db26-4ccb-b234-e310a0d8d02b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:32.175657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:32.227897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10e667-db26-4ccb-b234-e310a0d8d02b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:32.262301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:32.262903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:32.263199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:32.263475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:32.264136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] RBAC: Adding query filter params (name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:32.264434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:32.265794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:32.274022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 617/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Aug 18 20:37:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:32.279904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:32.367790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:32.383300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cc4d2-dc69-406d-bdd2-d47210409c5b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:32.416630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:32.417251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:32.417528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:32.417800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:32.428357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:32.429791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:32.443707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:32.444830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:32.446070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:32.446070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:32.446070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:32.446070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 620/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:32.450769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:32.547794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4739f9-a716-46bc-bb05-21625083ad72 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:32.557481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:32.582010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:32.582609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:32.582891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:32.583166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:32.583985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:32.584290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:32.585659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:32.597055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 618/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:32.602931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:32.711705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dd368-0ef1-4274-a711-a759b2d19426 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:32.745228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:32.745846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:32.746124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:32.746392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:32.749091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:32.753857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:32.755956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:32.767411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:32.770037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:32.771329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 621/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:32.774599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:32.879475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2403-e97d-4e9b-a144-526bb169f246 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:32.915054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:32.915713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:32.915998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:32.916277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:32.917096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:32.917449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:32.918879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:32.936775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 619/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:32.942926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:33.043671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779ed8-fa90-4c36-ace2-667a9dbf0be3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:33.077845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:33.078477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:33.078753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:33.079039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:33.141021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:33.147867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:33.149305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:33.243002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 622/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:37:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:37:33.248789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:33.276387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:33.347495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe9cc-9ddc-491c-ae9e-94590c4ed55c None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:33.381917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:33.382555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:33.382841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:33.383118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:33.393211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:33.394572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:33.408632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:33.409805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:33.411253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:33.411253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:33.411253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:33.411253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 620/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:33.415485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:33.508016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:33.514023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9944c9f-ef41-4cfc-bcb4-7806e9c71b69 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:33.547329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:33.547999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:33.548275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:33.548570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:33.549215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:33.549503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:33.550859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:33.562257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 623/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:33.568594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:33.647869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:33.668622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892424-a208-4a4c-931d-5be20916cea1 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:33.701051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:33.701666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:33.701944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:33.702209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:33.708622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:33.710046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:33.720795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:33.721932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:33.723125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 621/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:33.729533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:33.830771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9637b6-ae82-4318-bff6-b33fffe8ca6a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:33.864279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84d31c-7117-4eef-9ec9-a51e59c2eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:33.865491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d31c-7117-4eef-9ec9-a51e59c2eb33 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:33.865774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d31c-7117-4eef-9ec9-a51e59c2eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:33.866053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84d31c-7117-4eef-9ec9-a51e59c2eb33 None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:33.866740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d31c-7117-4eef-9ec9-a51e59c2eb33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:33.867048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d31c-7117-4eef-9ec9-a51e59c2eb33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:33.868518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84d31c-7117-4eef-9ec9-a51e59c2eb33 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:33.880196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 624/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:37:33.886759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:33.989541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52c69-2b8b-4718-8e75-b8f638aaa8f5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:34.023167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88472567-30c1-4adc-ae80-4713c32336d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:34.023809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472567-30c1-4adc-ae80-4713c32336d7 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:34.024097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472567-30c1-4adc-ae80-4713c32336d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:34.024377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472567-30c1-4adc-ae80-4713c32336d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:34.025106 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88472567-30c1-4adc-ae80-4713c32336d7 None admin] RBAC: Adding query filter params (role.id=79be860b24f44c24aa3d43cf616ffad8, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=4ee628c7459142eca1ebb60e1acfbeb0) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:34.025415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88472567-30c1-4adc-ae80-4713c32336d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:34.026842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88472567-30c1-4adc-ae80-4713c32336d7 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:34.032643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 622/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:37:33 2022] GET /identity/v3/role_assignments?user.id=4ee628c7459142eca1ebb60e1acfbeb0&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=79be860b24f44c24aa3d43cf616ffad8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:37:36.007962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745ff2a-7b40-4f74-96b6-703766a300ed None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.008514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745ff2a-7b40-4f74-96b6-703766a300ed None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.008514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745ff2a-7b40-4f74-96b6-703766a300ed None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.010155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 625/1247] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:36.015411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd6588-30c1-4d7b-8c92-525baffe1561 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.015828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd6588-30c1-4d7b-8c92-525baffe1561 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.015957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd6588-30c1-4d7b-8c92-525baffe1561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.022400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:36.034134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c0cd6588-30c1-4d7b-8c92-525baffe1561 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:36.035314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c0cd6588-30c1-4d7b-8c92-525baffe1561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:36.100635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 623/1248] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:37:36.371529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745ff2a-7b40-4f74-96b6-703766a300ed None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:36.389957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:36.471046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745ff2a-7b40-4f74-96b6-703766a300ed None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:36.504578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:36.505180 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.505459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.505730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.515963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:36.520673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:36.522286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:36.523140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 626/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:37:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:36.528684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd6588-30c1-4d7b-8c92-525baffe1561 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:36.625598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd6588-30c1-4d7b-8c92-525baffe1561 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:36.654960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:36.659786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:36.660393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.660675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.660980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.661641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:36.661946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:36.663336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:36.671159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 624/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:37:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:36.676937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:36.764111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:36.788095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b0a51-7365-476b-b00b-64e54d66825b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:36.823912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:36.824616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.824953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.825227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:36.837718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:36.839514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:36.855974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:36.856990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:36.857965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:36.857965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:36.857965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:36.857965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 627/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:36.863525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:36.964261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30feffb-14bf-4b68-9b2f-c1b010b3aec3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:36.998390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:36.999029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:36.999312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:36.999627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.000274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:37.000608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.001980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.014458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 625/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:37.020202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:37.119760 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bc419-e62a-426d-8c62-618be555daf6 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:37.145898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:37.153489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:37.154117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:37.154401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:37.154682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.162905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.164407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:37.175327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:37.176521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:37.178240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 628/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:37.183163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:37.238995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:37.283051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd305d8-b2bc-45ed-b78f-f752ce24f519 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:37.317598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:37.318200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:37.318507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:37.318782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.319603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:37.319905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.321329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.337909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 626/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:37.343831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:37.444555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2ee56-785e-4fb8-9213-c8c4cd40bbf3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:37.477128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:37.477722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:37.477997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:37.478265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.531457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:37.544553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.546065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.642943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 629/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:37:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:37:37.649809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:37.746736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfdc8-f2f0-4442-95e1-938d7329f585 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:37.760264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:37.780232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:37.780850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:37.781130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:37.781447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.794560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.794560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:37.807547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:37.813742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:37.814650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:37.814650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:37.814650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:37.814650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 627/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:37.814887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:37.901183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:37.913007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdb233-21cd-4015-8b0f-f6d993244637 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:37.946613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:37.947283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:37.947638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:37.947915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:37.948555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:37.948861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:37.950227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:37.962064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 630/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:37:37.968101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:38.067775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514ecb6-60ac-4f31-b691-8c275f700235 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:38.103933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:38.104562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:38.104841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:38.105119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:38.111959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:38.113441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:38.124713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:38.127656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:38.128798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 628/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:38.132469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:38.231300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa09d-4806-45b2-9acf-658247351be3 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:38.265565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67241d8-4865-42df-9857-5e6011ae6d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:38.266171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67241d8-4865-42df-9857-5e6011ae6d8d None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:38.266451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67241d8-4865-42df-9857-5e6011ae6d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:38.266724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67241d8-4865-42df-9857-5e6011ae6d8d None admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:38.267439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67241d8-4865-42df-9857-5e6011ae6d8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:38.267749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67241d8-4865-42df-9857-5e6011ae6d8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:38.269208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67241d8-4865-42df-9857-5e6011ae6d8d None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:38.281473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 631/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:38.287621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:38.314127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:38.393042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36e023-d1d4-41de-b793-b71ea64a9f36 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:38.429072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e44f6-c644-4ea2-94eb-9d834448b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:38.429733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e44f6-c644-4ea2-94eb-9d834448b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:38.430012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e44f6-c644-4ea2-94eb-9d834448b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:38.430283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e44f6-c644-4ea2-94eb-9d834448b3a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:38.431074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e44f6-c644-4ea2-94eb-9d834448b3a2 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=4ee628c7459142eca1ebb60e1acfbeb0) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:38.431482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e44f6-c644-4ea2-94eb-9d834448b3a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:38.433165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e44f6-c644-4ea2-94eb-9d834448b3a2 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:38.441132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 629/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:37:38 2022] GET /identity/v3/role_assignments?user.id=4ee628c7459142eca1ebb60e1acfbeb0&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=5eebc7f04cfc4979a378bf94830482af => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:40.316221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bba8-c9bf-4b31-a65c-09a77458529f None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.316778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bba8-c9bf-4b31-a65c-09a77458529f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.316778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bba8-c9bf-4b31-a65c-09a77458529f None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.318087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 632/1261] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:40.323799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37d19-1c0b-4218-accd-074707b5e915 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.324176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37d19-1c0b-4218-accd-074707b5e915 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.324354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37d19-1c0b-4218-accd-074707b5e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.343242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-62d37d19-1c0b-4218-accd-074707b5e915 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:40.344475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-62d37d19-1c0b-4218-accd-074707b5e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:40.411440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 630/1262] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:40.677525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19bba8-c9bf-4b31-a65c-09a77458529f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:40.688614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:40.781970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19bba8-c9bf-4b31-a65c-09a77458529f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:40.816703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:40.817313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.817590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.817861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.828356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:40.832998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:40.834141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:40.835164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 633/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:40.840362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d37d19-1c0b-4218-accd-074707b5e915 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:40.858221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:40.951230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d37d19-1c0b-4218-accd-074707b5e915 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:40.984979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:40.985586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:40.985871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:40.986146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:40.986815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:40.987157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:40.988559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:40.996583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 631/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:41.002403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.069034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.102295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2fa92-8c32-44df-bcce-2942ff3c769b None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.135159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.135844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.136129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.136403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.147073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.148587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:41.162657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:41.163912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:41.165070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:41.165070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:41.165070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:41.165070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 634/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:41.169793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.276823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.296226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72620fd7-135c-4247-8433-3bf8bc6702d6 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.328999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.329728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.330067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.330337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.330986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:41.331294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.332729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.343866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 632/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:41.350344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.454968 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c8ff-8a3d-40df-9a18-4091d00632b9 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.475347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.489417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.490042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.490323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.490596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.497938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.502111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:41.510457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:41.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:41.513071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 635/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:41.517430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.623585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a705b-be05-40e5-94c5-5e2ed4efcd5e None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.656845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.657449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.657740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.657995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.658728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:41.659031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.660501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.671135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:41.678836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 633/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:41.684739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.783093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c62b-7ff5-4765-bcbb-122563fc4027 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.819682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.820308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.820588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.820859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.831543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.833082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:41.847495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:41.848625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:41.849563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:41.849563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:41.849563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:41.849563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 636/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:41.854723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:41.956014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfe37-abb9-4c7a-8d29-983005062b74 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:41.989220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:41.989817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:41.990300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:41.990401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:41.991067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:41.991395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:41.992785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:42.003699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 634/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:42.010412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:42.041397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:42.108720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406ccb-428f-4105-b354-367093cb02a4 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:42.141952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:42.142569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:42.142854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:42.143130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:42.150253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:42.151727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:42.163379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:42.164358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:42.165740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 637/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:42.170325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:42.229427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:42.270402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e865c1-cce5-446a-abad-c0ad86794515 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:42.305476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134f29c-cc2c-44a9-bac7-db7d0911e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:42.306090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134f29c-cc2c-44a9-bac7-db7d0911e5bb None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:42.306373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134f29c-cc2c-44a9-bac7-db7d0911e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:42.306648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134f29c-cc2c-44a9-bac7-db7d0911e5bb None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:42.307343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134f29c-cc2c-44a9-bac7-db7d0911e5bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:42.307685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134f29c-cc2c-44a9-bac7-db7d0911e5bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:42.309102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134f29c-cc2c-44a9-bac7-db7d0911e5bb None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:42.321423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 635/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:42.327720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:42.421571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:42.430368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1077-87ca-44d5-b8eb-63e3530cb044 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:42.467637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450db8f1-113f-48e4-bd56-07c29dfed862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:42.468290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db8f1-113f-48e4-bd56-07c29dfed862 None admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:42.468570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db8f1-113f-48e4-bd56-07c29dfed862 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:42.468844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db8f1-113f-48e4-bd56-07c29dfed862 None admin] PATH_INFO: `/v3/projects/49b0bf8795f8481eb78257251b454156/users/4ee628c7459142eca1ebb60e1acfbeb0/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:42.470893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450db8f1-113f-48e4-bd56-07c29dfed862 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b0bf8795f8481eb78257251b454156, user_id=4ee628c7459142eca1ebb60e1acfbeb0, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:42.472461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450db8f1-113f-48e4-bd56-07c29dfed862 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:42.576853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 638/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Aug 18 20:37:42 2022] PUT /identity/v3/projects/49b0bf8795f8481eb78257251b454156/users/4ee628c7459142eca1ebb60e1acfbeb0/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:37:44.473895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6083-525c-4276-89be-94ced72f6d01 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:44.474443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6083-525c-4276-89be-94ced72f6d01 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:44.474443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6083-525c-4276-89be-94ced72f6d01 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:44.475859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 636/1274] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:44.481116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf63a-312a-48a5-8883-e0fb892dcdbd None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:44.481599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf63a-312a-48a5-8883-e0fb892dcdbd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:44.481693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf63a-312a-48a5-8883-e0fb892dcdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:44.499832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-deccf63a-312a-48a5-8883-e0fb892dcdbd None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:44.501042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-deccf63a-312a-48a5-8883-e0fb892dcdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:44.567417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 639/1275] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:44.847428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6083-525c-4276-89be-94ced72f6d01 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:44.962130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6083-525c-4276-89be-94ced72f6d01 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:44.984814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.003617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.004268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.004551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.004824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.017167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:37:45.022070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:45.023028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:45.024164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 637/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Aug 18 20:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:45.029332 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccf63a-312a-48a5-8883-e0fb892dcdbd None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.120818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.139608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccf63a-312a-48a5-8883-e0fb892dcdbd None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.175972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.176600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.176885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.177157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.177864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:45.178167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.179567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.188788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 640/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:45.194387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.310733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5552-cbba-45f0-8c99-8b757ae4a2c5 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.345638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.346277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.346558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.346831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.358204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.359680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:45.373996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:45.374957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:45.376287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:45.376287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:45.376287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:45.376287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 638/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:45.381021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.479767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb2a3-8533-4a05-ba4d-c7c4ebab211e None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.512918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.519573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.519573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.519573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.519573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:45.519573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.519573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.528402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 641/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:45.534122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.564856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.636060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558ee9b-67d3-4c96-9552-245e62ca317d None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.669423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.670051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.670331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.670604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.677417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.678854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:37:45.691026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:45.692150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:45.693807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 639/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:45.698494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.702271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.797326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c6c0-6c72-4042-b70c-e379403c0e9a None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.830251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.830841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.831120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.831417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:45.832142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:45.832439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:45.835422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:45.851836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 642/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:45.859846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:45.952379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:45.961220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65489-eb08-4b1e-9509-0ff76853ebf3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:45.997484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:45.998086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:45.998365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:45.998673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.064265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.065711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.152991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:46.162955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 640/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Aug 18 20:37:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:37:46.169635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.230448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:46.269024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8924-9238-43d3-b2aa-6250c71c6057 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.305950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.306597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.306877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.307172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.317123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.321260 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:37:46.332725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:46.333836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:37:46.335146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:37:46.335146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:37:46.335146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:46.335146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 643/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:46.339709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.438723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941743c4-d0bb-4456-985c-992d34388e0f None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.471673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.472281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.472562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.472840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.473483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:46.473993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.475696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.487785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 641/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Aug 18 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:46.493722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.590069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c5078-d845-4d6b-845a-a2365a08fa91 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.603815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:46.623246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.623899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.624183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.624458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.630941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.633002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:37:46.644080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:46.645152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: ERROR keystone.server.flask.application Aug 18 20:37:46.646301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 644/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Aug 18 20:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:46.652161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.702437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:46.750650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d69f6-5e57-4945-b98f-7a85905b71a9 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.783993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875af99-0e8d-4e38-9f08-e4d4554ddbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.784629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875af99-0e8d-4e38-9f08-e4d4554ddbb3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.784913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875af99-0e8d-4e38-9f08-e4d4554ddbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.785191 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875af99-0e8d-4e38-9f08-e4d4554ddbb3 None admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.785890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875af99-0e8d-4e38-9f08-e4d4554ddbb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:46.786203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875af99-0e8d-4e38-9f08-e4d4554ddbb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.789588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875af99-0e8d-4e38-9f08-e4d4554ddbb3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.806325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 642/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Aug 18 20:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:46.812432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:46.910364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c808be1-98ed-4369-9ad4-a10e14527187 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:46.943241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b7102-c8de-4a7f-ba29-c6c812429576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:46.944580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b7102-c8de-4a7f-ba29-c6c812429576 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:46.944862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b7102-c8de-4a7f-ba29-c6c812429576 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:46.945135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b7102-c8de-4a7f-ba29-c6c812429576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:46.945851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b7102-c8de-4a7f-ba29-c6c812429576 None admin] RBAC: Adding query filter params (role.id=5eebc7f04cfc4979a378bf94830482af, scope.project.id=49b0bf8795f8481eb78257251b454156, user.id=4ee628c7459142eca1ebb60e1acfbeb0) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:46.946159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b7102-c8de-4a7f-ba29-c6c812429576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:46.947649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b7102-c8de-4a7f-ba29-c6c812429576 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:46.953351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 645/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Aug 18 20:37:46 2022] GET /identity/v3/role_assignments?user.id=4ee628c7459142eca1ebb60e1acfbeb0&scope.project.id=49b0bf8795f8481eb78257251b454156&role.id=5eebc7f04cfc4979a378bf94830482af => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:48.866903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c303e42-5420-4f49-a91c-fb863a0b5416 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:48.867482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c303e42-5420-4f49-a91c-fb863a0b5416 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:48.867482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c303e42-5420-4f49-a91c-fb863a0b5416 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:48.868867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 643/1288] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:48.876424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8b83d-500c-4ee9-ace5-e0b8eecac0d1 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:48.876930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8b83d-500c-4ee9-ace5-e0b8eecac0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:48.876930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8b83d-500c-4ee9-ace5-e0b8eecac0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:48.895671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-bcd8b83d-500c-4ee9-ace5-e0b8eecac0d1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:48.897482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bcd8b83d-500c-4ee9-ace5-e0b8eecac0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:48.926291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:48.962518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 646/1289] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:49.228631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c303e42-5420-4f49-a91c-fb863a0b5416 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:49.329794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c303e42-5420-4f49-a91c-fb863a0b5416 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:49.340243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:49.363453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:49.364078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:49.364357 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:49.364626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] PATH_INFO: `/v3/services/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:49.365245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:49.366710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:49.375166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:49.379630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:49.380702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 644/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:37:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:49.382780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8b83d-500c-4ee9-ace5-e0b8eecac0d1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:49.479724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8b83d-500c-4ee9-ace5-e0b8eecac0d1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:49.514126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f9546-9d71-4f74-b1bb-eac897ebbc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:49.514766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9546-9d71-4f74-b1bb-eac897ebbc15 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:49.515046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9546-9d71-4f74-b1bb-eac897ebbc15 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:49.515318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9546-9d71-4f74-b1bb-eac897ebbc15 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:49.515992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f9546-9d71-4f74-b1bb-eac897ebbc15 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:49.516296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f9546-9d71-4f74-b1bb-eac897ebbc15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:49.517663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f9546-9d71-4f74-b1bb-eac897ebbc15 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:49.522436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 647/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Aug 18 20:37:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:49.528313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:49.627125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706e6d-0a6a-4a54-a483-37ea3864f8ef None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:49.660006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528815c-7c57-4f73-92f3-20d3c1b715d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:49.660605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528815c-7c57-4f73-92f3-20d3c1b715d4 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:49.660886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528815c-7c57-4f73-92f3-20d3c1b715d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:49.661159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528815c-7c57-4f73-92f3-20d3c1b715d4 None admin] PATH_INFO: `/v3/services` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:49.661794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528815c-7c57-4f73-92f3-20d3c1b715d4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:49.662097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528815c-7c57-4f73-92f3-20d3c1b715d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:49.664072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528815c-7c57-4f73-92f3-20d3c1b715d4 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:49.668535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 645/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Aug 18 20:37:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:51.613521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcc11e-c46c-4fd5-9e92-0f4f97506943 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:51.614038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcc11e-c46c-4fd5-9e92-0f4f97506943 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:51.614038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcc11e-c46c-4fd5-9e92-0f4f97506943 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:51.615976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 648/1293] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:51.621122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b940f8-0e3f-4749-bc4a-1c4f8314e35c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:51.621560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b940f8-0e3f-4749-bc4a-1c4f8314e35c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:51.621741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b940f8-0e3f-4749-bc4a-1c4f8314e35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:51.640155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-92b940f8-0e3f-4749-bc4a-1c4f8314e35c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:51.641349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-92b940f8-0e3f-4749-bc4a-1c4f8314e35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:51.670605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:51.706515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 646/1294] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:37:51.979754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcc11e-c46c-4fd5-9e92-0f4f97506943 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:52.010107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:52.078896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcc11e-c46c-4fd5-9e92-0f4f97506943 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:52.113766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a8d50-f278-4bd6-8dd8-7cd243595242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:52.114365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a8d50-f278-4bd6-8dd8-7cd243595242 None admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:52.114644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a8d50-f278-4bd6-8dd8-7cd243595242 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:52.114915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a8d50-f278-4bd6-8dd8-7cd243595242 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:52.115638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a8d50-f278-4bd6-8dd8-7cd243595242 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:52.117000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a8d50-f278-4bd6-8dd8-7cd243595242 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:52.222874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 649/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Aug 18 20:37:51 2022] POST /identity/v3/services => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:37:54.147123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1130-5a35-4651-b6d6-42819f12a81a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.147755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1130-5a35-4651-b6d6-42819f12a81a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.147858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1130-5a35-4651-b6d6-42819f12a81a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.149127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 647/1296] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:54.154525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008972f-163b-43b8-9c97-359536ae47e8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.154928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008972f-163b-43b8-9c97-359536ae47e8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.155079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008972f-163b-43b8-9c97-359536ae47e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.173078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8008972f-163b-43b8-9c97-359536ae47e8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:54.174265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8008972f-163b-43b8-9c97-359536ae47e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:54.246142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 650/1297] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:54.515113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1130-5a35-4651-b6d6-42819f12a81a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:54.619522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1130-5a35-4651-b6d6-42819f12a81a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:54.685609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:54.686295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.686534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.686810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.687459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:54.688874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:54.697925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:54.699224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:54.700407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 648/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:37:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:54.705336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008972f-163b-43b8-9c97-359536ae47e8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:54.724134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:54.802229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008972f-163b-43b8-9c97-359536ae47e8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:54.835621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:54.836377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.836674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.836949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.837575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:54.837920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:54.839404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:54.844754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 651/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Aug 18 20:37:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:54.850569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:54.881873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:54.952634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73477d-94b6-409c-af6d-ffa85f433634 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:54.985166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906f5cc-0b49-40d4-a95d-cc284f6b271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:54.985875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f5cc-0b49-40d4-a95d-cc284f6b271c None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:54.986129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f5cc-0b49-40d4-a95d-cc284f6b271c None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:54.986404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f5cc-0b49-40d4-a95d-cc284f6b271c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:54.987121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906f5cc-0b49-40d4-a95d-cc284f6b271c None admin] RBAC: Adding query filter params (interface=public, service_id=8f8e6236b9174955b097d1300c885525, region_id=RegionOne) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:54.987459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906f5cc-0b49-40d4-a95d-cc284f6b271c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:54.988841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906f5cc-0b49-40d4-a95d-cc284f6b271c None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:54.995185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 649/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Aug 18 20:37:54 2022] GET /identity/v3/endpoints?service_id=8f8e6236b9174955b097d1300c885525&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:55.001207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:55.086599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:55.104154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5bf33-8e9b-48ef-a0c3-1de4b102b882 None admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:55.138202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631f6d-cee5-41f4-8299-e51edd6419b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:55.138800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631f6d-cee5-41f4-8299-e51edd6419b0 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:55.139080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631f6d-cee5-41f4-8299-e51edd6419b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:55.139477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631f6d-cee5-41f4-8299-e51edd6419b0 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:55.140088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77631f6d-cee5-41f4-8299-e51edd6419b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:55.141533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77631f6d-cee5-41f4-8299-e51edd6419b0 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:55.148789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 652/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Aug 18 20:37:55 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:37:57.065513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dd383-a47c-46e3-b49b-20b849dab779 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:57.066071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dd383-a47c-46e3-b49b-20b849dab779 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:57.066071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dd383-a47c-46e3-b49b-20b849dab779 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:57.067468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 650/1302] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:37:57.073155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d681-94f9-4ca0-a054-220dfa238a5a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:57.073552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d681-94f9-4ca0-a054-220dfa238a5a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:57.073771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d681-94f9-4ca0-a054-220dfa238a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:57.092102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6f69d681-94f9-4ca0-a054-220dfa238a5a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:37:57.093314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6f69d681-94f9-4ca0-a054-220dfa238a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:37:57.160220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 653/1303] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:37:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:37:57.437966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dd383-a47c-46e3-b49b-20b849dab779 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:57.534087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:57.541396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dd383-a47c-46e3-b49b-20b849dab779 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:57.575172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:57.575890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:57.576178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:57.576489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:57.577108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:57.578613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:37:57.587155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:37:57.588189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application with Lock( Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: ERROR keystone.server.flask.application Aug 18 20:37:57.589197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 651/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Aug 18 20:37:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:37:57.594558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d681-94f9-4ca0-a054-220dfa238a5a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:57.669683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:37:57.692310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d681-94f9-4ca0-a054-220dfa238a5a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:57.727530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462894a0-811e-4bfd-b091-4d2fd3595fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:57.737210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462894a0-811e-4bfd-b091-4d2fd3595fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:57.737210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462894a0-811e-4bfd-b091-4d2fd3595fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:57.737210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462894a0-811e-4bfd-b091-4d2fd3595fd4 None admin] PATH_INFO: `/v3/services` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:57.737210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462894a0-811e-4bfd-b091-4d2fd3595fd4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:37:57.737210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462894a0-811e-4bfd-b091-4d2fd3595fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:57.737210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462894a0-811e-4bfd-b091-4d2fd3595fd4 None admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:57.737731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 654/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Aug 18 20:37:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:37:57.742519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:37:57.843451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d307a-0ed7-4d99-ab5c-88d4e2e092d3 None admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:37:57.875416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0d07d-7775-4258-bdc7-e7ee9af94981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:37:57.876015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d07d-7775-4258-bdc7-e7ee9af94981 None admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:37:57.876295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d07d-7775-4258-bdc7-e7ee9af94981 None admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:37:57.876566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d07d-7775-4258-bdc7-e7ee9af94981 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:37:57.877231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0d07d-7775-4258-bdc7-e7ee9af94981 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:37:57.878596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0d07d-7775-4258-bdc7-e7ee9af94981 None admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:37:58.011507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 652/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:37:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:38:07.771048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=30 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:38:08.006579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:50.277309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921aa1-3a6c-4fa1-9022-0da36e96d61e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:50.277892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921aa1-3a6c-4fa1-9022-0da36e96d61e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:50.277892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921aa1-3a6c-4fa1-9022-0da36e96d61e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:50.285128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b043-0bfc-4cc8-a0fa-67774fd939bd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:50.285622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b043-0bfc-4cc8-a0fa-67774fd939bd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:50.285725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b043-0bfc-4cc8-a0fa-67774fd939bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:50.290663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 655/1307] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:44:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:44:50.364436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3311b043-0bfc-4cc8-a0fa-67774fd939bd None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:44:50.365663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3311b043-0bfc-4cc8-a0fa-67774fd939bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:50.487803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 653/1308] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:44:50.781523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a3de4-f21c-4b3e-8159-b2c6c9603904 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:50.782098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a3de4-f21c-4b3e-8159-b2c6c9603904 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:50.782588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a3de4-f21c-4b3e-8159-b2c6c9603904 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:50.784706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 656/1309] 10.222.0.62 () {54 vars in 965 bytes} [Thu Aug 18 20:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:44:50.791443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090254-ac0d-4a93-b0b7-e3559e8b2b73 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:50.792022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090254-ac0d-4a93-b0b7-e3559e8b2b73 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:50.792515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090254-ac0d-4a93-b0b7-e3559e8b2b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:50.909780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1a090254-ac0d-4a93-b0b7-e3559e8b2b73 None None] MFA Rules not processed for user `162eb7d6a9894e4ca60aa8da4537a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:44:50.911423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1a090254-ac0d-4a93-b0b7-e3559e8b2b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:50.936060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:50.998717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 654/1310] 10.222.0.62 () {58 vars in 1062 bytes} [Thu Aug 18 20:44:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 18 20:44:51.009585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a3de4-f21c-4b3e-8159-b2c6c9603904 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:44:51.011729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4f2a3de4-f21c-4b3e-8159-b2c6c9603904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:51.173778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a3de4-f21c-4b3e-8159-b2c6c9603904 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:44:51.278327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79bee0-2a30-44f6-8888-96fbd3afc2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:44:51.279681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79bee0-2a30-44f6-8888-96fbd3afc2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:51.280207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79bee0-2a30-44f6-8888-96fbd3afc2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:51.280743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79bee0-2a30-44f6-8888-96fbd3afc2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:51.282980 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4f79bee0-2a30-44f6-8888-96fbd3afc2b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:51.353052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:51.429866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79bee0-2a30-44f6-8888-96fbd3afc2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:44:51.431346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79bee0-2a30-44f6-8888-96fbd3afc2b8 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:44:51.454736 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 657/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:44:53.693523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d35258-93d3-4a11-955a-6eeeb68ec3f4 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:53.694036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d35258-93d3-4a11-955a-6eeeb68ec3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:53.694036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d35258-93d3-4a11-955a-6eeeb68ec3f4 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:53.695326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 655/1312] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:44:53.700550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c6c2-7e6e-46b0-b447-0c2aa683b121 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:53.700981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c6c2-7e6e-46b0-b447-0c2aa683b121 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:53.701143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c6c2-7e6e-46b0-b447-0c2aa683b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:53.785019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c253c6c2-7e6e-46b0-b447-0c2aa683b121 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:44:53.786237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c253c6c2-7e6e-46b0-b447-0c2aa683b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:53.893055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 658/1313] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:44:54.194205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22da2-e6d7-4533-80e8-0c9faed659a3 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:54.194597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22da2-e6d7-4533-80e8-0c9faed659a3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:54.194986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22da2-e6d7-4533-80e8-0c9faed659a3 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:54.196422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 656/1314] 10.222.0.62 () {54 vars in 965 bytes} [Thu Aug 18 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:44:54.202570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122df1dd-932e-4c20-b437-0de84fa5b0c2 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:54.202900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122df1dd-932e-4c20-b437-0de84fa5b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:54.203183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122df1dd-932e-4c20-b437-0de84fa5b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:54.214786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:54.281714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-122df1dd-932e-4c20-b437-0de84fa5b0c2 None None] MFA Rules not processed for user `162eb7d6a9894e4ca60aa8da4537a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:44:54.282948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-122df1dd-932e-4c20-b437-0de84fa5b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:54.360452 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 659/1315] 10.222.0.62 () {58 vars in 1062 bytes} [Thu Aug 18 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:44:54.369513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf22da2-e6d7-4533-80e8-0c9faed659a3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:44:54.371085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8cf22da2-e6d7-4533-80e8-0c9faed659a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:54.479830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf22da2-e6d7-4533-80e8-0c9faed659a3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:44:54.551502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:54.553856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb87e-b563-480b-8e85-faf3415e379b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:44:54.554473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb87e-b563-480b-8e85-faf3415e379b service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:54.554755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb87e-b563-480b-8e85-faf3415e379b service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:54.555027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb87e-b563-480b-8e85-faf3415e379b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:54.556675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8c0eb87e-b563-480b-8e85-faf3415e379b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:54.665691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0eb87e-b563-480b-8e85-faf3415e379b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:44:54.667124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0eb87e-b563-480b-8e85-faf3415e379b service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:44:54.686209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 657/1316] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:44:57.337888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349267b7-82b9-44b0-b914-15c94af96dca None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:57.338428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349267b7-82b9-44b0-b914-15c94af96dca None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:57.338428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349267b7-82b9-44b0-b914-15c94af96dca None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:57.339828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 660/1317] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:44:57.345183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b5b84-e9fe-4a88-9fc0-6f2b7308df7f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:57.345683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b5b84-e9fe-4a88-9fc0-6f2b7308df7f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:57.345890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b5b84-e9fe-4a88-9fc0-6f2b7308df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:57.410066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ce2b5b84-e9fe-4a88-9fc0-6f2b7308df7f None None] MFA Rules not processed for user `740bcdcd97aa425ab9c8b2dd49a9a962`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:44:57.411276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ce2b5b84-e9fe-4a88-9fc0-6f2b7308df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:57.462990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:57.508703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 658/1318] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:44:57.794517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349267b7-82b9-44b0-b914-15c94af96dca None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:44:57.796700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-349267b7-82b9-44b0-b914-15c94af96dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:57.897204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349267b7-82b9-44b0-b914-15c94af96dca None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:44:57.900052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:44:57.970323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03e1fd-5405-48b7-894d-480de759a546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:44:57.970944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03e1fd-5405-48b7-894d-480de759a546 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:44:57.971251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03e1fd-5405-48b7-894d-480de759a546 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:44:57.971551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03e1fd-5405-48b7-894d-480de759a546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:44:57.973173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7a03e1fd-5405-48b7-894d-480de759a546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:44:58.106109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03e1fd-5405-48b7-894d-480de759a546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:44:58.106109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03e1fd-5405-48b7-894d-480de759a546 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:44:58.110437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 661/1319] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:44:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:00.839300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91824d-5716-422d-922e-9e5cb453c2a2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:00.839882 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91824d-5716-422d-922e-9e5cb453c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:00.839882 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91824d-5716-422d-922e-9e5cb453c2a2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:00.841306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 659/1320] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:00.846557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324de7c-c9fa-475f-a687-1eba26151483 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:00.846996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324de7c-c9fa-475f-a687-1eba26151483 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:00.847161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324de7c-c9fa-475f-a687-1eba26151483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:00.887674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:00.913272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7324de7c-c9fa-475f-a687-1eba26151483 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:00.914541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7324de7c-c9fa-475f-a687-1eba26151483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:01.021018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 662/1321] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:01.305555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91824d-5716-422d-922e-9e5cb453c2a2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:01.307125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cc91824d-5716-422d-922e-9e5cb453c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:01.412594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91824d-5716-422d-922e-9e5cb453c2a2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:01.489077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fa627-9fb6-4c17-a6a1-3b80ae8bd2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:01.489690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fa627-9fb6-4c17-a6a1-3b80ae8bd2db service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:01.489971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fa627-9fb6-4c17-a6a1-3b80ae8bd2db service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:01.490246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fa627-9fb6-4c17-a6a1-3b80ae8bd2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:01.491914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-557fa627-9fb6-4c17-a6a1-3b80ae8bd2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:01.500140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:01.601111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fa627-9fb6-4c17-a6a1-3b80ae8bd2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:01.602465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fa627-9fb6-4c17-a6a1-3b80ae8bd2db service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:01.620353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 660/1322] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:04.515989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355a86-49db-45d0-83c7-1f5494bff04c None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:04.516565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355a86-49db-45d0-83c7-1f5494bff04c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:04.516565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355a86-49db-45d0-83c7-1f5494bff04c None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:04.517822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 663/1323] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:04.523504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4d13-b66b-48e0-b709-e69003303cdd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:04.524116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4d13-b66b-48e0-b709-e69003303cdd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:04.524116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4d13-b66b-48e0-b709-e69003303cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:04.594221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9c5e4d13-b66b-48e0-b709-e69003303cdd None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:04.595447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9c5e4d13-b66b-48e0-b709-e69003303cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:04.657292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:04.709996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 661/1324] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:05.018284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355a86-49db-45d0-83c7-1f5494bff04c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:05.020123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6c355a86-49db-45d0-83c7-1f5494bff04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:05.138421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355a86-49db-45d0-83c7-1f5494bff04c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:05.157127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:05.225871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad391b2-9597-4f2a-a47c-9ec684d69323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:05.226571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad391b2-9597-4f2a-a47c-9ec684d69323 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:05.226860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad391b2-9597-4f2a-a47c-9ec684d69323 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:05.227132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad391b2-9597-4f2a-a47c-9ec684d69323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:05.228807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4ad391b2-9597-4f2a-a47c-9ec684d69323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:05.345062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad391b2-9597-4f2a-a47c-9ec684d69323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:05.348904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad391b2-9597-4f2a-a47c-9ec684d69323 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:05.366672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 664/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:07.411430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8ca9d-1ecc-4fb2-b79b-5957ca086796 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:07.412025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8ca9d-1ecc-4fb2-b79b-5957ca086796 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:07.412025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8ca9d-1ecc-4fb2-b79b-5957ca086796 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:07.413335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 662/1326] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:07.418715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d89e0a-044e-46f3-823d-8d8c822d287b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:07.419753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d89e0a-044e-46f3-823d-8d8c822d287b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:07.419884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d89e0a-044e-46f3-823d-8d8c822d287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:07.471165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:07.490946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d6d89e0a-044e-46f3-823d-8d8c822d287b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:07.492507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d6d89e0a-044e-46f3-823d-8d8c822d287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:07.598842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 665/1327] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:07.889100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8ca9d-1ecc-4fb2-b79b-5957ca086796 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:07.890713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-55b8ca9d-1ecc-4fb2-b79b-5957ca086796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:08.002471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8ca9d-1ecc-4fb2-b79b-5957ca086796 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:08.085176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244f2d1-74c8-43a9-8c7b-c8f30c206821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:08.085818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244f2d1-74c8-43a9-8c7b-c8f30c206821 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:08.086099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244f2d1-74c8-43a9-8c7b-c8f30c206821 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:08.086371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244f2d1-74c8-43a9-8c7b-c8f30c206821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:08.088026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9244f2d1-74c8-43a9-8c7b-c8f30c206821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:08.106196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:08.221579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244f2d1-74c8-43a9-8c7b-c8f30c206821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:08.223067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244f2d1-74c8-43a9-8c7b-c8f30c206821 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:08.247193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 663/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:10.291031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263b4d-59e0-4722-9506-7a1eb1fbecbb None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:10.291717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263b4d-59e0-4722-9506-7a1eb1fbecbb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:10.291717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263b4d-59e0-4722-9506-7a1eb1fbecbb None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:10.293107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 666/1329] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:10.299289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae474c-52b8-4c98-bddd-bb9b7430ee61 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:10.301445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae474c-52b8-4c98-bddd-bb9b7430ee61 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:10.301445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae474c-52b8-4c98-bddd-bb9b7430ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:10.374349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-adae474c-52b8-4c98-bddd-bb9b7430ee61 None None] MFA Rules not processed for user `740bcdcd97aa425ab9c8b2dd49a9a962`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:10.375594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-adae474c-52b8-4c98-bddd-bb9b7430ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:10.444779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:10.478980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 664/1330] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:10.770857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263b4d-59e0-4722-9506-7a1eb1fbecbb None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:10.772588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-15263b4d-59e0-4722-9506-7a1eb1fbecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:10.882985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263b4d-59e0-4722-9506-7a1eb1fbecbb None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:10.921890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:11.003987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086201-ff0c-4868-8fb8-cfc9715a6573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:11.004609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086201-ff0c-4868-8fb8-cfc9715a6573 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:11.004892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086201-ff0c-4868-8fb8-cfc9715a6573 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:11.005168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086201-ff0c-4868-8fb8-cfc9715a6573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:11.006847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bf086201-ff0c-4868-8fb8-cfc9715a6573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:11.127952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086201-ff0c-4868-8fb8-cfc9715a6573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:11.129402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086201-ff0c-4868-8fb8-cfc9715a6573 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:11.148469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 667/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:13.688289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ebae1-7c23-49ab-8bf7-7384b33e620c None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:13.688815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ebae1-7c23-49ab-8bf7-7384b33e620c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:13.688815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ebae1-7c23-49ab-8bf7-7384b33e620c None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:13.690104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 665/1332] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:13.695193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88aa9-d593-4394-a308-e101d34ea0b6 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:13.695633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88aa9-d593-4394-a308-e101d34ea0b6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:13.695779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88aa9-d593-4394-a308-e101d34ea0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:13.765019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:13.767947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-4ef88aa9-d593-4394-a308-e101d34ea0b6 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:13.769192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4ef88aa9-d593-4394-a308-e101d34ea0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:13.874139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 668/1333] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:45:14.158250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ebae1-7c23-49ab-8bf7-7384b33e620c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:14.159889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-be5ebae1-7c23-49ab-8bf7-7384b33e620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:14.267388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ebae1-7c23-49ab-8bf7-7384b33e620c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:14.354301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f99aa-27bc-4af7-ae43-75992aeefbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:14.354919 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f99aa-27bc-4af7-ae43-75992aeefbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:14.355198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f99aa-27bc-4af7-ae43-75992aeefbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:14.355500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f99aa-27bc-4af7-ae43-75992aeefbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:14.357310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-af7f99aa-27bc-4af7-ae43-75992aeefbe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:14.386906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:14.482915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f99aa-27bc-4af7-ae43-75992aeefbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:14.484434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f99aa-27bc-4af7-ae43-75992aeefbe0 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:14.504220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 666/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:16.502236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ab9c-df6a-4b4c-bc03-5ab8182f15bf None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:16.502850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ab9c-df6a-4b4c-bc03-5ab8182f15bf None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:16.502850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ab9c-df6a-4b4c-bc03-5ab8182f15bf None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:16.504222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 669/1335] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:16.509316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450828e-a7af-4304-9f4c-dffccc9f8805 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:16.509716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450828e-a7af-4304-9f4c-dffccc9f8805 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:16.509870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450828e-a7af-4304-9f4c-dffccc9f8805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:16.575397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a450828e-a7af-4304-9f4c-dffccc9f8805 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:16.576640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a450828e-a7af-4304-9f4c-dffccc9f8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:16.651371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:16.674001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 667/1336] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:16.960489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304ab9c-df6a-4b4c-bc03-5ab8182f15bf None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:16.962062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3304ab9c-df6a-4b4c-bc03-5ab8182f15bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:17.066333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304ab9c-df6a-4b4c-bc03-5ab8182f15bf None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:17.095101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:17.147375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d0cd-4168-493e-9959-e30eddf2cc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:17.148004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d0cd-4168-493e-9959-e30eddf2cc54 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:17.148287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d0cd-4168-493e-9959-e30eddf2cc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:17.148559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d0cd-4168-493e-9959-e30eddf2cc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:17.150179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6227d0cd-4168-493e-9959-e30eddf2cc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:17.257671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d0cd-4168-493e-9959-e30eddf2cc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:17.259121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d0cd-4168-493e-9959-e30eddf2cc54 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:17.277475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 670/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:19.863096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db76f8-cd23-4df7-897e-7386b8fc6115 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:19.863669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db76f8-cd23-4df7-897e-7386b8fc6115 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:19.863791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db76f8-cd23-4df7-897e-7386b8fc6115 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:19.865096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 668/1338] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:19.870164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f417-0393-43af-a568-c8708da4afbe None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:19.870559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f417-0393-43af-a568-c8708da4afbe None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:19.870720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f417-0393-43af-a568-c8708da4afbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:19.936753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-86b8f417-0393-43af-a568-c8708da4afbe None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:19.937999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-86b8f417-0393-43af-a568-c8708da4afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:19.947188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:20.038378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 671/1339] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:20.321544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db76f8-cd23-4df7-897e-7386b8fc6115 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:20.323146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a2db76f8-cd23-4df7-897e-7386b8fc6115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:20.428729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db76f8-cd23-4df7-897e-7386b8fc6115 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:20.503878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f503fb4-34c5-4f08-ba2b-a21d12274ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:20.504481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503fb4-34c5-4f08-ba2b-a21d12274ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:20.504760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503fb4-34c5-4f08-ba2b-a21d12274ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:20.505027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503fb4-34c5-4f08-ba2b-a21d12274ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:20.506644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2f503fb4-34c5-4f08-ba2b-a21d12274ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:20.544704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:20.625484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f503fb4-34c5-4f08-ba2b-a21d12274ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:20.626984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f503fb4-34c5-4f08-ba2b-a21d12274ef6 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:20.652647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 669/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:24.869878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67e1b-baea-46a0-b097-8bd0977e8474 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:24.870450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67e1b-baea-46a0-b097-8bd0977e8474 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:24.870450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67e1b-baea-46a0-b097-8bd0977e8474 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:24.872343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 672/1341] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:24.877621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a179-704c-4050-9479-c36dd1364e41 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:24.878078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a179-704c-4050-9479-c36dd1364e41 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:24.878237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a179-704c-4050-9479-c36dd1364e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:24.944784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-56b8a179-704c-4050-9479-c36dd1364e41 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:24.946021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-56b8a179-704c-4050-9479-c36dd1364e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:25.038513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:25.049837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 670/1342] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:25.337082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a67e1b-baea-46a0-b097-8bd0977e8474 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:25.338722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-25a67e1b-baea-46a0-b097-8bd0977e8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:25.453331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a67e1b-baea-46a0-b097-8bd0977e8474 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:25.491958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:25.529682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3131-b671-419e-95d0-7e0c921dc34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:25.530285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3131-b671-419e-95d0-7e0c921dc34e service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:25.530566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3131-b671-419e-95d0-7e0c921dc34e service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:25.530907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3131-b671-419e-95d0-7e0c921dc34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:25.532558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a2fe3131-b671-419e-95d0-7e0c921dc34e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:25.645997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3131-b671-419e-95d0-7e0c921dc34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:25.647548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3131-b671-419e-95d0-7e0c921dc34e service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:25.667137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 673/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:28.528284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643986c0-a360-4941-8ec5-3dd0066ed82f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:28.528817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643986c0-a360-4941-8ec5-3dd0066ed82f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:28.528817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643986c0-a360-4941-8ec5-3dd0066ed82f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:28.530185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 671/1344] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:28.535626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e9ff-7c39-4214-8272-cf54f9e4d925 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:28.536052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e9ff-7c39-4214-8272-cf54f9e4d925 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:28.536188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e9ff-7c39-4214-8272-cf54f9e4d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:28.601766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-06f9e9ff-7c39-4214-8272-cf54f9e4d925 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:28.602985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-06f9e9ff-7c39-4214-8272-cf54f9e4d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:28.621053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:28.701329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 674/1345] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:28.987654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643986c0-a360-4941-8ec5-3dd0066ed82f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:28.989248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-643986c0-a360-4941-8ec5-3dd0066ed82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:29.101361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643986c0-a360-4941-8ec5-3dd0066ed82f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:29.179591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cd63c-edf5-4067-8ccd-3fb84a3b926c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:29.180208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cd63c-edf5-4067-8ccd-3fb84a3b926c service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:29.180491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cd63c-edf5-4067-8ccd-3fb84a3b926c service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:29.180767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cd63c-edf5-4067-8ccd-3fb84a3b926c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:29.182439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-047cd63c-edf5-4067-8ccd-3fb84a3b926c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:29.228064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:29.299597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cd63c-edf5-4067-8ccd-3fb84a3b926c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:29.301050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cd63c-edf5-4067-8ccd-3fb84a3b926c service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:29.321198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 672/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:33.780710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79512c-ba67-4caf-bf8e-e49cb24a878c None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:33.781231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79512c-ba67-4caf-bf8e-e49cb24a878c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:33.781231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79512c-ba67-4caf-bf8e-e49cb24a878c None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:33.782610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 675/1347] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:33.788109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea291a81-87b7-4af8-98f0-2e070dfc5bb5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:33.788539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea291a81-87b7-4af8-98f0-2e070dfc5bb5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:33.788678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea291a81-87b7-4af8-98f0-2e070dfc5bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:33.863626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ea291a81-87b7-4af8-98f0-2e070dfc5bb5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:33.864870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ea291a81-87b7-4af8-98f0-2e070dfc5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:33.971803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:33.974748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 673/1348] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:34.258173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79512c-ba67-4caf-bf8e-e49cb24a878c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:34.259857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9c79512c-ba67-4caf-bf8e-e49cb24a878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:34.398308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79512c-ba67-4caf-bf8e-e49cb24a878c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:34.459399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:34.486548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c6618-f143-4b60-845e-1e9a1001a007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:34.487151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c6618-f143-4b60-845e-1e9a1001a007 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:34.487458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c6618-f143-4b60-845e-1e9a1001a007 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:34.487720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c6618-f143-4b60-845e-1e9a1001a007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:34.489334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d99c6618-f143-4b60-845e-1e9a1001a007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:34.601910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c6618-f143-4b60-845e-1e9a1001a007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:34.603400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c6618-f143-4b60-845e-1e9a1001a007 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:34.622606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 676/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:39.640627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f4db0-73cd-4401-839c-1a7013cf4d3a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:39.641149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f4db0-73cd-4401-839c-1a7013cf4d3a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:39.641232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f4db0-73cd-4401-839c-1a7013cf4d3a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:39.642966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 674/1350] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:39.648891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816b45-af9c-4322-9984-7fdefd1e19bf None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:39.649317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816b45-af9c-4322-9984-7fdefd1e19bf None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:39.649522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816b45-af9c-4322-9984-7fdefd1e19bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:39.739877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9a816b45-af9c-4322-9984-7fdefd1e19bf None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:39.741257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9a816b45-af9c-4322-9984-7fdefd1e19bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:39.762142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:39.898865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 677/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:45:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:44.254381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88108640-1da2-46bb-8060-0ecfa3d369cc None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:44.255478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88108640-1da2-46bb-8060-0ecfa3d369cc None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:44.256086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88108640-1da2-46bb-8060-0ecfa3d369cc None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:44.257926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 675/1352] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:44.263888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749f09-32f5-4f10-9375-fe2b2f09564d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:44.264323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749f09-32f5-4f10-9375-fe2b2f09564d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:44.264445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749f09-32f5-4f10-9375-fe2b2f09564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:44.349789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-63749f09-32f5-4f10-9375-fe2b2f09564d None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:44.351067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-63749f09-32f5-4f10-9375-fe2b2f09564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:44.436289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:44.479059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 678/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:45:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:45.796988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a9b7-aa79-4c5a-b7f8-948236077b68 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:45.797646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a9b7-aa79-4c5a-b7f8-948236077b68 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:45.797646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a9b7-aa79-4c5a-b7f8-948236077b68 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:45.799050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 676/1354] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:45.804056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b07a-5f4a-4b9c-aa50-4d8422abec25 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:45.804541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b07a-5f4a-4b9c-aa50-4d8422abec25 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:45.804638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b07a-5f4a-4b9c-aa50-4d8422abec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:45.897648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d2b7b07a-5f4a-4b9c-aa50-4d8422abec25 None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:45.898879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d2b7b07a-5f4a-4b9c-aa50-4d8422abec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:46.019624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 679/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:45:49.300599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379714b8-be88-407a-904b-ccc1213fa04a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:49.301149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379714b8-be88-407a-904b-ccc1213fa04a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:49.301149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379714b8-be88-407a-904b-ccc1213fa04a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:49.302479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 677/1356] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:49.307593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137be63b-df92-400c-9a69-3d0b41d03086 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:49.308057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137be63b-df92-400c-9a69-3d0b41d03086 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:49.308161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137be63b-df92-400c-9a69-3d0b41d03086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:49.360160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:49.395504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-137be63b-df92-400c-9a69-3d0b41d03086 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:49.396802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-137be63b-df92-400c-9a69-3d0b41d03086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:49.531341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 680/1357] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:49.838872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9601-3811-4d2e-be81-083b81451c7a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:49.839634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9601-3811-4d2e-be81-083b81451c7a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:49.840181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9601-3811-4d2e-be81-083b81451c7a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:49.842244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 678/1358] 10.222.0.62 () {54 vars in 962 bytes} [Thu Aug 18 20:45:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:49.850358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d4b5-3f69-4cf6-99b3-521f7ff8b83b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:49.851921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d4b5-3f69-4cf6-99b3-521f7ff8b83b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:49.852406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d4b5-3f69-4cf6-99b3-521f7ff8b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:49.955635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fdc0d4b5-3f69-4cf6-99b3-521f7ff8b83b None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:49.957215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fdc0d4b5-3f69-4cf6-99b3-521f7ff8b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:50.012505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:50.084153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 681/1359] 10.222.0.62 () {58 vars in 1059 bytes} [Thu Aug 18 20:45:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:45:50.092507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c9601-3811-4d2e-be81-083b81451c7a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:50.094025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ee3c9601-3811-4d2e-be81-083b81451c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:50.265783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c9601-3811-4d2e-be81-083b81451c7a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:50.355286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:50.386150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c329fc6-85b2-4abc-ba59-edde244dbedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:50.386809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c329fc6-85b2-4abc-ba59-edde244dbedd service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:50.387083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c329fc6-85b2-4abc-ba59-edde244dbedd service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:50.387434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c329fc6-85b2-4abc-ba59-edde244dbedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:50.389232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2c329fc6-85b2-4abc-ba59-edde244dbedd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:50.491817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c329fc6-85b2-4abc-ba59-edde244dbedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:50.493426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c329fc6-85b2-4abc-ba59-edde244dbedd service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:50.512009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 679/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:52.676367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf766-6143-4c8d-937e-ec28adef6296 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:52.676934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf766-6143-4c8d-937e-ec28adef6296 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:52.676934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf766-6143-4c8d-937e-ec28adef6296 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:52.682832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 682/1361] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:52.684239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae9a-f1ff-4efb-830a-85f2fc9c1fcf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:52.684682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae9a-f1ff-4efb-830a-85f2fc9c1fcf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:52.684779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae9a-f1ff-4efb-830a-85f2fc9c1fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:52.759256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9fdcae9a-f1ff-4efb-830a-85f2fc9c1fcf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:52.760631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9fdcae9a-f1ff-4efb-830a-85f2fc9c1fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:52.801866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:52.869110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 680/1362] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:45:53.161800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf766-6143-4c8d-937e-ec28adef6296 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:53.163231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3acbf766-6143-4c8d-937e-ec28adef6296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:53.323557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf766-6143-4c8d-937e-ec28adef6296 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:53.333500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:53.453838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c38b-dc90-4d95-9a9e-c1721470d08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:53.454366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c38b-dc90-4d95-9a9e-c1721470d08e service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:53.454648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c38b-dc90-4d95-9a9e-c1721470d08e service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:53.454921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c38b-dc90-4d95-9a9e-c1721470d08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:53.456602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-db37c38b-dc90-4d95-9a9e-c1721470d08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:53.570908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37c38b-dc90-4d95-9a9e-c1721470d08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:53.572571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37c38b-dc90-4d95-9a9e-c1721470d08e service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:53.592431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 683/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:55.951646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c1056-8b56-4b6c-8ae9-90bb963624a1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:55.952185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c1056-8b56-4b6c-8ae9-90bb963624a1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:55.952185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c1056-8b56-4b6c-8ae9-90bb963624a1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:55.953552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 681/1364] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:55.959166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c42c-fde6-4eca-a2a6-6d649356b323 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:55.959695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c42c-fde6-4eca-a2a6-6d649356b323 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:55.959795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c42c-fde6-4eca-a2a6-6d649356b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:55.978945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:56.041375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c808c42c-fde6-4eca-a2a6-6d649356b323 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:56.043187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c808c42c-fde6-4eca-a2a6-6d649356b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:56.157099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 684/1365] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:56.451879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ed96-8a8b-4f91-8553-6d44f5edde20 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:56.452303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ed96-8a8b-4f91-8553-6d44f5edde20 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:56.452681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ed96-8a8b-4f91-8553-6d44f5edde20 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:56.454179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 682/1366] 10.222.0.62 () {54 vars in 962 bytes} [Thu Aug 18 20:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:56.459937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a3232-0dd7-4590-9e81-1b76e57434d9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:56.476928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a3232-0dd7-4590-9e81-1b76e57434d9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:56.476928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a3232-0dd7-4590-9e81-1b76e57434d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:56.542265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-243a3232-0dd7-4590-9e81-1b76e57434d9 None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:56.544096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-243a3232-0dd7-4590-9e81-1b76e57434d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:56.585923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:56.675026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 685/1367] 10.222.0.62 () {58 vars in 1059 bytes} [Thu Aug 18 20:45:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:56.683082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2ed96-8a8b-4f91-8553-6d44f5edde20 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:56.685279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-81e2ed96-8a8b-4f91-8553-6d44f5edde20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:56.856909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2ed96-8a8b-4f91-8553-6d44f5edde20 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:56.882223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:56.984163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b59bf-0890-43dc-9638-d9b4cefda03e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:56.985032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b59bf-0890-43dc-9638-d9b4cefda03e service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:56.985325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b59bf-0890-43dc-9638-d9b4cefda03e service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:56.985656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b59bf-0890-43dc-9638-d9b4cefda03e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:56.987326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c44b59bf-0890-43dc-9638-d9b4cefda03e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:57.097397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b59bf-0890-43dc-9638-d9b4cefda03e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:57.099056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b59bf-0890-43dc-9638-d9b4cefda03e service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:57.122586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 683/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:57.723078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0f39-55bd-4121-b6a6-ba59485801b6 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:57.723677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0f39-55bd-4121-b6a6-ba59485801b6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:57.723677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0f39-55bd-4121-b6a6-ba59485801b6 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:57.725198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 686/1369] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:57.730894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb943ec-067d-4a72-a6a5-f4a53609f131 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:57.731189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb943ec-067d-4a72-a6a5-f4a53609f131 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:57.731515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb943ec-067d-4a72-a6a5-f4a53609f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:57.767179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:57.805997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3eb943ec-067d-4a72-a6a5-f4a53609f131 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:57.807238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3eb943ec-067d-4a72-a6a5-f4a53609f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:57.916687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 684/1370] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:58.473165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec650cb-7353-4b58-a7d9-141a38da59cd None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:58.473434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec650cb-7353-4b58-a7d9-141a38da59cd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:58.473711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec650cb-7353-4b58-a7d9-141a38da59cd None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:58.475213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 687/1371] 10.222.0.62 () {54 vars in 964 bytes} [Thu Aug 18 20:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:45:58.480393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc6bb-e9b8-47af-a157-1acbec7be4e5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:58.480393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc6bb-e9b8-47af-a157-1acbec7be4e5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:58.481690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc6bb-e9b8-47af-a157-1acbec7be4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:58.563020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a8dbc6bb-e9b8-47af-a157-1acbec7be4e5 None None] MFA Rules not processed for user `b743dbcea55f4ab7b339eb7dc6e30630`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:58.564416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a8dbc6bb-e9b8-47af-a157-1acbec7be4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:58.613978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:58.648471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 685/1372] 10.222.0.62 () {58 vars in 1061 bytes} [Thu Aug 18 20:45:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:58.656169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec650cb-7353-4b58-a7d9-141a38da59cd None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:58.657713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-eec650cb-7353-4b58-a7d9-141a38da59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:58.772640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec650cb-7353-4b58-a7d9-141a38da59cd None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:58.818842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:58.861854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24702992-0fa9-4baf-ab00-bde806cf65ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:45:58.862470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24702992-0fa9-4baf-ab00-bde806cf65ad service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:58.862749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24702992-0fa9-4baf-ab00-bde806cf65ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:58.863018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24702992-0fa9-4baf-ab00-bde806cf65ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:58.864670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-24702992-0fa9-4baf-ab00-bde806cf65ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:58.985677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24702992-0fa9-4baf-ab00-bde806cf65ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:45:58.987114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24702992-0fa9-4baf-ab00-bde806cf65ad service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:45:59.007723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 688/1373] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:45:59.279224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cebbc-e8fe-41af-8891-a665617119e0 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:59.279560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cebbc-e8fe-41af-8891-a665617119e0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:59.279841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cebbc-e8fe-41af-8891-a665617119e0 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:59.281268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 686/1374] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:45:59.288306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de335fa-a7a1-4cf3-88db-1162d71c16d2 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:45:59.288599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de335fa-a7a1-4cf3-88db-1162d71c16d2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:45:59.288876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de335fa-a7a1-4cf3-88db-1162d71c16d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:45:59.356831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7de335fa-a7a1-4cf3-88db-1162d71c16d2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:45:59.358051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7de335fa-a7a1-4cf3-88db-1162d71c16d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:59.379214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:59.457370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 689/1375] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:45:59.751823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cebbc-e8fe-41af-8891-a665617119e0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:45:59.754343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-887cebbc-e8fe-41af-8891-a665617119e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:45:59.914446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cebbc-e8fe-41af-8891-a665617119e0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:45:59.968680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:00.031565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248a119-31a0-4012-9b11-cf1a58239412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:00.032174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248a119-31a0-4012-9b11-cf1a58239412 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:00.032454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248a119-31a0-4012-9b11-cf1a58239412 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:00.032725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248a119-31a0-4012-9b11-cf1a58239412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:00.034341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2248a119-31a0-4012-9b11-cf1a58239412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:00.126754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248a119-31a0-4012-9b11-cf1a58239412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:00.128458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248a119-31a0-4012-9b11-cf1a58239412 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:00.147301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 687/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:02.225472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3308609-a6b2-4e3f-8a51-575c7bc238a1 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:02.225947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3308609-a6b2-4e3f-8a51-575c7bc238a1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:02.226042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3308609-a6b2-4e3f-8a51-575c7bc238a1 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:02.227479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 690/1377] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:02.233231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163483-08b2-4e00-abd8-8edbf192720c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:02.233642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163483-08b2-4e00-abd8-8edbf192720c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:02.233895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163483-08b2-4e00-abd8-8edbf192720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:02.327880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bd163483-08b2-4e00-abd8-8edbf192720c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:02.329316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bd163483-08b2-4e00-abd8-8edbf192720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:02.347985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:02.456118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 688/1378] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:02.763395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3308609-a6b2-4e3f-8a51-575c7bc238a1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:02.765662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d3308609-a6b2-4e3f-8a51-575c7bc238a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:02.991797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3308609-a6b2-4e3f-8a51-575c7bc238a1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:02.996590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:03.142363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450dd82-7379-4141-8f95-a7fb75a39abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:03.142975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450dd82-7379-4141-8f95-a7fb75a39abe service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:03.143258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450dd82-7379-4141-8f95-a7fb75a39abe service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:03.143561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450dd82-7379-4141-8f95-a7fb75a39abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:03.145498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b450dd82-7379-4141-8f95-a7fb75a39abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:03.255828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450dd82-7379-4141-8f95-a7fb75a39abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:03.257587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450dd82-7379-4141-8f95-a7fb75a39abe service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:03.277651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 691/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:05.368768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e3b6-9b4a-4202-9154-e593522fe6a7 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:05.369383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e3b6-9b4a-4202-9154-e593522fe6a7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:05.369383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e3b6-9b4a-4202-9154-e593522fe6a7 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:05.371557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 689/1380] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:05.376955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372bffc-3f53-446a-9627-47ddd4630457 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:05.377415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372bffc-3f53-446a-9627-47ddd4630457 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:05.377528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372bffc-3f53-446a-9627-47ddd4630457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:05.389899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:05.465218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0372bffc-3f53-446a-9627-47ddd4630457 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:05.467348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0372bffc-3f53-446a-9627-47ddd4630457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:05.583773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 692/1381] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:05.888270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105e3b6-9b4a-4202-9154-e593522fe6a7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:05.889784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6105e3b6-9b4a-4202-9154-e593522fe6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:06.063009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:06.074668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105e3b6-9b4a-4202-9154-e593522fe6a7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:06.205850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c65d1-0921-429d-9f5f-2c6c37f1e2bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:06.206546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c65d1-0921-429d-9f5f-2c6c37f1e2bc service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:06.206921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c65d1-0921-429d-9f5f-2c6c37f1e2bc service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:06.207355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c65d1-0921-429d-9f5f-2c6c37f1e2bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:06.209254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-732c65d1-0921-429d-9f5f-2c6c37f1e2bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:06.312938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c65d1-0921-429d-9f5f-2c6c37f1e2bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:06.314651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c65d1-0921-429d-9f5f-2c6c37f1e2bc service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:06.327077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:06.337274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 690/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:08.495101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da15e9-8512-48a7-b88e-71eb9574a1c0 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:08.496251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da15e9-8512-48a7-b88e-71eb9574a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:08.496251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da15e9-8512-48a7-b88e-71eb9574a1c0 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:08.497684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 693/1383] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:08.503965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9a2c-2dac-4a62-b65f-b5e5a5e5a4a8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:08.504461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9a2c-2dac-4a62-b65f-b5e5a5e5a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:08.504723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9a2c-2dac-4a62-b65f-b5e5a5e5a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:08.581032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c82d9a2c-2dac-4a62-b65f-b5e5a5e5a4a8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:08.582548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c82d9a2c-2dac-4a62-b65f-b5e5a5e5a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:08.689708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 691/1384] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:08.984430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da15e9-8512-48a7-b88e-71eb9574a1c0 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:08.986341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e2da15e9-8512-48a7-b88e-71eb9574a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:09.079853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:09.158004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da15e9-8512-48a7-b88e-71eb9574a1c0 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:09.280011 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a526511-fe69-4ea5-9778-5ae5fa34b51c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:09.280740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526511-fe69-4ea5-9778-5ae5fa34b51c service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:09.281081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526511-fe69-4ea5-9778-5ae5fa34b51c service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:09.281420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526511-fe69-4ea5-9778-5ae5fa34b51c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:09.283152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5a526511-fe69-4ea5-9778-5ae5fa34b51c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:09.341043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:09.389831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a526511-fe69-4ea5-9778-5ae5fa34b51c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:09.391495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a526511-fe69-4ea5-9778-5ae5fa34b51c service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:09.411936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 694/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:11.345990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6157e-8b32-4078-aaf3-8f741b549c94 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:11.346985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6157e-8b32-4078-aaf3-8f741b549c94 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:11.346985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6157e-8b32-4078-aaf3-8f741b549c94 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:11.348329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 692/1386] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:11.359245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5ea4-87e4-4770-881c-ef99aa819201 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:11.359883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5ea4-87e4-4770-881c-ef99aa819201 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:11.359883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5ea4-87e4-4770-881c-ef99aa819201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:11.427486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e6cd5ea4-87e4-4770-881c-ef99aa819201 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:11.428718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e6cd5ea4-87e4-4770-881c-ef99aa819201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:11.538484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 695/1387] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:11.911146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6157e-8b32-4078-aaf3-8f741b549c94 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:11.912994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c4d6157e-8b32-4078-aaf3-8f741b549c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:12.002298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:12.089843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6157e-8b32-4078-aaf3-8f741b549c94 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:12.223322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc2581-2a49-4868-baec-526aef9ff1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:12.223928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc2581-2a49-4868-baec-526aef9ff1af service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:12.224225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc2581-2a49-4868-baec-526aef9ff1af service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:12.224510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc2581-2a49-4868-baec-526aef9ff1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:12.226390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-10cc2581-2a49-4868-baec-526aef9ff1af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:12.271160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:12.337651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc2581-2a49-4868-baec-526aef9ff1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:12.339421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc2581-2a49-4868-baec-526aef9ff1af service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:12.363628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 693/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:14.455741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0880dc-4f3f-41bd-9496-1b41b7ffe8ca None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:14.456303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0880dc-4f3f-41bd-9496-1b41b7ffe8ca None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:14.456303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0880dc-4f3f-41bd-9496-1b41b7ffe8ca None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:14.457640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 696/1389] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:14.462894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4c6a1-cc76-424f-b082-65867ddfcb93 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:14.463328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4c6a1-cc76-424f-b082-65867ddfcb93 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:14.463603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4c6a1-cc76-424f-b082-65867ddfcb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:14.532660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-81c4c6a1-cc76-424f-b082-65867ddfcb93 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:14.533897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-81c4c6a1-cc76-424f-b082-65867ddfcb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:14.632050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 694/1390] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:14.641645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6b44b-937e-4519-bb8c-d5e8bf3a9fe0 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:14.641645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6b44b-937e-4519-bb8c-d5e8bf3a9fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:14.641645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6b44b-937e-4519-bb8c-d5e8bf3a9fe0 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:14.641645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 697/1391] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:14.646449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a258-7952-4030-afd1-43059e4f7820 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:14.646733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a258-7952-4030-afd1-43059e4f7820 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:14.647038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a258-7952-4030-afd1-43059e4f7820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:14.662788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:14.713974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3363a258-7952-4030-afd1-43059e4f7820 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:14.715887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3363a258-7952-4030-afd1-43059e4f7820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:14.814341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 695/1392] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:14.929387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6b44b-937e-4519-bb8c-d5e8bf3a9fe0 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:14.930926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-09c6b44b-937e-4519-bb8c-d5e8bf3a9fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:14.962100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:15.081755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6b44b-937e-4519-bb8c-d5e8bf3a9fe0 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:15.118773 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6785d3d-d08f-4a5d-a7f1-cee1e3fa37f1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:15.119065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6785d3d-d08f-4a5d-a7f1-cee1e3fa37f1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:15.119349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6785d3d-d08f-4a5d-a7f1-cee1e3fa37f1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:15.121265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 696/1393] 10.222.0.62 () {54 vars in 967 bytes} [Thu Aug 18 20:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:15.126626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebdf1-1281-46b1-b9d5-c27a9193f388 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:15.126911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebdf1-1281-46b1-b9d5-c27a9193f388 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:15.127189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebdf1-1281-46b1-b9d5-c27a9193f388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:15.189773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:15.203123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:15.203796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:15.204105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:15.204412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:15.206040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:15.212871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0ceebdf1-1281-46b1-b9d5-c27a9193f388 None None] MFA Rules not processed for user `c1f59dfd806f4d1cada6a42f5fce3b27`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:15.266808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0ceebdf1-1281-46b1-b9d5-c27a9193f388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:15.313864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:15.315510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:15.336072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 698/1394] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:15.372213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:15.413705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 697/1395] 10.222.0.62 () {58 vars in 1064 bytes} [Thu Aug 18 20:46:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:46:15.422115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:15.423332 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:15.501945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70db68-baee-44f2-b028-15eecfa12be7 service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:15.559212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:15.595641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f5c3f-8ebd-4698-92ca-0dfe250da7f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:15.596528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5c3f-8ebd-4698-92ca-0dfe250da7f9 service glance] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:15.596934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5c3f-8ebd-4698-92ca-0dfe250da7f9 service glance] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:15.597253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5c3f-8ebd-4698-92ca-0dfe250da7f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:15.600520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-872f5c3f-8ebd-4698-92ca-0dfe250da7f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:15.716597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f5c3f-8ebd-4698-92ca-0dfe250da7f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:15.718043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f5c3f-8ebd-4698-92ca-0dfe250da7f9 service glance] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:15.736923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 699/1396] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:16.759937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16cecf-00b7-4c2f-ae6a-4fec57f824e7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:16.760451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16cecf-00b7-4c2f-ae6a-4fec57f824e7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:16.760553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16cecf-00b7-4c2f-ae6a-4fec57f824e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:16.831824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ad16cecf-00b7-4c2f-ae6a-4fec57f824e7 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:16.833051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ad16cecf-00b7-4c2f-ae6a-4fec57f824e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:16.926214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 698/1397] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:46:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:16.975736 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c5154-fae7-4f61-b789-4e13f00dcc39 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:16.976310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c5154-fae7-4f61-b789-4e13f00dcc39 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:16.976310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c5154-fae7-4f61-b789-4e13f00dcc39 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:16.978111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 700/1398] 10.222.0.62 () {54 vars in 943 bytes} [Thu Aug 18 20:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:16.985313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302205-b199-437f-88d6-035d50d44e37 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:16.986890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302205-b199-437f-88d6-035d50d44e37 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:16.986890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302205-b199-437f-88d6-035d50d44e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:17.049023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:17.070512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-31302205-b199-437f-88d6-035d50d44e37 None None] MFA Rules not processed for user `bc7bfd9c93404d8ea4260832d1b0e284`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:17.071821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-31302205-b199-437f-88d6-035d50d44e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:17.185479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 699/1399] 10.222.0.62 () {58 vars in 1040 bytes} [Thu Aug 18 20:46:16 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:17.195601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c5154-fae7-4f61-b789-4e13f00dcc39 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:17.197165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-709c5154-fae7-4f61-b789-4e13f00dcc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:17.274340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:17.336195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c5154-fae7-4f61-b789-4e13f00dcc39 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:17.447765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:17.448458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:17.448733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:17.449012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:17.450661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:17.480998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44546-090e-4ccd-8666-45209cd4824e None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:17.481281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44546-090e-4ccd-8666-45209cd4824e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:17.481554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44546-090e-4ccd-8666-45209cd4824e None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:17.483182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 700/1400] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:46:17.488447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d84c-16ff-4c6d-a219-3b6f20108fcf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:17.488728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d84c-16ff-4c6d-a219-3b6f20108fcf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:17.488997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d84c-16ff-4c6d-a219-3b6f20108fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:17.513408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:17.538654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:17.540514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:17.549837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 701/1401] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:46:17.558657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9649d84c-16ff-4c6d-a219-3b6f20108fcf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:17.559393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9649d84c-16ff-4c6d-a219-3b6f20108fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:17.617133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:17.659486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 701/1402] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:17.980392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:17.981609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:18.088455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320866-218a-4e12-9d9b-c2218f8c689e service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:18.201995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:18.216044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab1e4-a0ee-4de8-8efa-08511dc8a9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:18.216746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab1e4-a0ee-4de8-8efa-08511dc8a9c5 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:18.217027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab1e4-a0ee-4de8-8efa-08511dc8a9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:18.217296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab1e4-a0ee-4de8-8efa-08511dc8a9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:18.218916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7caab1e4-a0ee-4de8-8efa-08511dc8a9c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:18.340389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caab1e4-a0ee-4de8-8efa-08511dc8a9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:18.342001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caab1e4-a0ee-4de8-8efa-08511dc8a9c5 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:18.370860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 702/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:20.483583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da0a0-1289-4062-81f5-a543150f4532 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:20.484145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da0a0-1289-4062-81f5-a543150f4532 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:20.484234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da0a0-1289-4062-81f5-a543150f4532 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:20.485676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 702/1404] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:20.496210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f49e2-dfb6-4fca-8634-d92e305c4a32 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:20.496757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f49e2-dfb6-4fca-8634-d92e305c4a32 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:20.497235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f49e2-dfb6-4fca-8634-d92e305c4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:20.590232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7c9f49e2-dfb6-4fca-8634-d92e305c4a32 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:20.591491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7c9f49e2-dfb6-4fca-8634-d92e305c4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:20.657166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:20.699379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 703/1405] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:21.052119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6da0a0-1289-4062-81f5-a543150f4532 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:21.054655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7b6da0a0-1289-4062-81f5-a543150f4532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:21.250818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6da0a0-1289-4062-81f5-a543150f4532 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:21.309334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:21.404692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4620377-7733-4232-8d3a-2ba317121f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:21.405309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4620377-7733-4232-8d3a-2ba317121f46 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:21.405642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4620377-7733-4232-8d3a-2ba317121f46 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:21.405907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4620377-7733-4232-8d3a-2ba317121f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:21.407631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e4620377-7733-4232-8d3a-2ba317121f46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:21.515511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4620377-7733-4232-8d3a-2ba317121f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:21.517123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4620377-7733-4232-8d3a-2ba317121f46 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:21.536912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 703/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:23.751324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ccc39-5822-4f2f-9dfa-696b082f506c None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:23.751936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ccc39-5822-4f2f-9dfa-696b082f506c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:23.751936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ccc39-5822-4f2f-9dfa-696b082f506c None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:23.753416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 704/1407] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:23.758866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb904b7-35b8-412a-a1e1-e8b9a78850d7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:23.759386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb904b7-35b8-412a-a1e1-e8b9a78850d7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:23.759510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb904b7-35b8-412a-a1e1-e8b9a78850d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:23.825055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:23.833166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-dcb904b7-35b8-412a-a1e1-e8b9a78850d7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:23.836093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-dcb904b7-35b8-412a-a1e1-e8b9a78850d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:23.949762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 704/1408] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:24.246823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ccc39-5822-4f2f-9dfa-696b082f506c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:24.248410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-675ccc39-5822-4f2f-9dfa-696b082f506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:24.423914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ccc39-5822-4f2f-9dfa-696b082f506c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:24.480251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:24.562784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3b97f-9806-4bb4-9788-67176119a6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:24.563418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b97f-9806-4bb4-9788-67176119a6bd service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:24.563703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b97f-9806-4bb4-9788-67176119a6bd service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:24.564098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b97f-9806-4bb4-9788-67176119a6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:24.565722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b3b3b97f-9806-4bb4-9788-67176119a6bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:24.666801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3b97f-9806-4bb4-9788-67176119a6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:24.668431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3b97f-9806-4bb4-9788-67176119a6bd service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:24.689489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 705/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:33.948531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=44 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:34.687092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=77 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:41.184244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881eff-2bb5-41f6-8a68-1b292ed38645 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:41.184840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881eff-2bb5-41f6-8a68-1b292ed38645 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:41.184840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881eff-2bb5-41f6-8a68-1b292ed38645 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:41.186206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 705/1410] 10.222.0.62 () {54 vars in 918 bytes} [Thu Aug 18 20:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:41.191530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8693c51-bdca-476e-b10b-e281bdb974aa None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:41.191966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8693c51-bdca-476e-b10b-e281bdb974aa None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:41.192109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8693c51-bdca-476e-b10b-e281bdb974aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:41.271594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-f8693c51-bdca-476e-b10b-e281bdb974aa None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:41.272987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f8693c51-bdca-476e-b10b-e281bdb974aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:41.388397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 706/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Thu Aug 18 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:41.403430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fe17-fa80-4f32-ae73-1e331e636bb1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:41.403722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fe17-fa80-4f32-ae73-1e331e636bb1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:41.404000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fe17-fa80-4f32-ae73-1e331e636bb1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:41.405330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 706/1412] 10.222.0.62 () {54 vars in 918 bytes} [Thu Aug 18 20:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:41.410114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124759b8-5700-44be-b4f1-f905354c615f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:41.410542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124759b8-5700-44be-b4f1-f905354c615f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:41.410674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124759b8-5700-44be-b4f1-f905354c615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:41.494758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:41.498276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-124759b8-5700-44be-b4f1-f905354c615f None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:41.499566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-124759b8-5700-44be-b4f1-f905354c615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:41.624875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 707/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Thu Aug 18 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:44.065015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367c24-209c-4af9-bb41-ace8880b6455 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:44.065565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367c24-209c-4af9-bb41-ace8880b6455 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:44.065565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367c24-209c-4af9-bb41-ace8880b6455 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:44.066902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:46:44.072085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f681a-a39f-4316-b914-ad2c619b88d4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:44.073003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f681a-a39f-4316-b914-ad2c619b88d4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:44.073178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f681a-a39f-4316-b914-ad2c619b88d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:44.139494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-531f681a-a39f-4316-b914-ad2c619b88d4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:44.140933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-531f681a-a39f-4316-b914-ad2c619b88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:44.212952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:44.266149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:44.554097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39367c24-209c-4af9-bb41-ace8880b6455 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:44.555501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-39367c24-209c-4af9-bb41-ace8880b6455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:44.702615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39367c24-209c-4af9-bb41-ace8880b6455 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:44.776829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:44.816190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71ceb2-d200-442c-8571-9df490437501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:44.816995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ceb2-d200-442c-8571-9df490437501 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:44.817610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ceb2-d200-442c-8571-9df490437501 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:44.817889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ceb2-d200-442c-8571-9df490437501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:44.819572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1a71ceb2-d200-442c-8571-9df490437501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:44.909074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71ceb2-d200-442c-8571-9df490437501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:44.910683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71ceb2-d200-442c-8571-9df490437501 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:44.928388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 708/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:45.816666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae853-4d9f-4ebf-b84a-82c1872ac9b6 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:45.817194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae853-4d9f-4ebf-b84a-82c1872ac9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:45.817194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae853-4d9f-4ebf-b84a-82c1872ac9b6 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:45.818458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:45.823521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e046-37a2-485b-83ec-3648089367ea None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:45.823953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e046-37a2-485b-83ec-3648089367ea None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:45.824116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e046-37a2-485b-83ec-3648089367ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:45.900079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e128e046-37a2-485b-83ec-3648089367ea None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:45.901803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e128e046-37a2-485b-83ec-3648089367ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:45.928975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:46.007257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:46.158144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbae853-4d9f-4ebf-b84a-82c1872ac9b6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:46.159626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dfbae853-4d9f-4ebf-b84a-82c1872ac9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:46.323865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbae853-4d9f-4ebf-b84a-82c1872ac9b6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:46.366057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:46.437610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429e49-135d-4062-b1c0-36af1f42c2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:46.438131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429e49-135d-4062-b1c0-36af1f42c2d1 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:46.438410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429e49-135d-4062-b1c0-36af1f42c2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:46.438680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429e49-135d-4062-b1c0-36af1f42c2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:46.440334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a4429e49-135d-4062-b1c0-36af1f42c2d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:46.531781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429e49-135d-4062-b1c0-36af1f42c2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:46.533380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429e49-135d-4062-b1c0-36af1f42c2d1 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:46.551728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 710/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:47.448658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d9a0-2879-47c0-b23c-513ba0007568 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:47.449277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d9a0-2879-47c0-b23c-513ba0007568 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:47.449277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d9a0-2879-47c0-b23c-513ba0007568 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:47.450619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:47.455782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c65996-e5a7-459c-91a2-2a3c832474f1 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:47.456257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c65996-e5a7-459c-91a2-2a3c832474f1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:47.456368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c65996-e5a7-459c-91a2-2a3c832474f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:47.510908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:47.532798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-25c65996-e5a7-459c-91a2-2a3c832474f1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:47.540331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-25c65996-e5a7-459c-91a2-2a3c832474f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:47.639789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:47.791813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d9a0-2879-47c0-b23c-513ba0007568 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:47.793352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9e67d9a0-2879-47c0-b23c-513ba0007568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:47.943907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d9a0-2879-47c0-b23c-513ba0007568 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:47.956548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:48.058609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680d890-831e-436f-9052-a2770163c322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:48.059217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680d890-831e-436f-9052-a2770163c322 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:48.059529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680d890-831e-436f-9052-a2770163c322 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:48.059805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680d890-831e-436f-9052-a2770163c322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:48.061507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b680d890-831e-436f-9052-a2770163c322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:48.152595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680d890-831e-436f-9052-a2770163c322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:48.154201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680d890-831e-436f-9052-a2770163c322 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:48.171964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 711/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:49.050693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af3bf-66a8-4b63-ac45-d37375af762e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:49.051202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af3bf-66a8-4b63-ac45-d37375af762e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:49.051202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af3bf-66a8-4b63-ac45-d37375af762e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:49.052535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:49.058129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c51d-7ebc-4b59-8110-584b7b1cf861 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:49.058532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c51d-7ebc-4b59-8110-584b7b1cf861 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:49.058684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c51d-7ebc-4b59-8110-584b7b1cf861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:49.079063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:49.133872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7211c51d-7ebc-4b59-8110-584b7b1cf861 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:49.135694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7211c51d-7ebc-4b59-8110-584b7b1cf861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:49.235265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:49.387138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af3bf-66a8-4b63-ac45-d37375af762e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:49.392780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3c8af3bf-66a8-4b63-ac45-d37375af762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:49.502886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:49.542899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af3bf-66a8-4b63-ac45-d37375af762e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:49.657167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5baa09-f374-4676-bf71-dc922fa1d5e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:49.657688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5baa09-f374-4676-bf71-dc922fa1d5e4 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:49.657961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5baa09-f374-4676-bf71-dc922fa1d5e4 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:49.658230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5baa09-f374-4676-bf71-dc922fa1d5e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:49.659869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7c5baa09-f374-4676-bf71-dc922fa1d5e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:49.735684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:49.748846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5baa09-f374-4676-bf71-dc922fa1d5e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:49.750578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5baa09-f374-4676-bf71-dc922fa1d5e4 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:49.768882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 713/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:50.645408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007498e7-8cba-4d9d-8f00-98316935c966 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:50.645942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007498e7-8cba-4d9d-8f00-98316935c966 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:50.645942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007498e7-8cba-4d9d-8f00-98316935c966 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:50.647250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:50.652238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ffbe9-792b-4fa6-883e-789a007c82d9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:50.652698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ffbe9-792b-4fa6-883e-789a007c82d9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:50.652817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ffbe9-792b-4fa6-883e-789a007c82d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:50.729901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-838ffbe9-792b-4fa6-883e-789a007c82d9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:50.731114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-838ffbe9-792b-4fa6-883e-789a007c82d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:50.827607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:50.981417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007498e7-8cba-4d9d-8f00-98316935c966 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:50.982973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-007498e7-8cba-4d9d-8f00-98316935c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:51.078995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:51.142268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007498e7-8cba-4d9d-8f00-98316935c966 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:51.255232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a4673-739a-4271-8cec-4adbfbc3ec01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:51.255876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a4673-739a-4271-8cec-4adbfbc3ec01 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:51.256151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a4673-739a-4271-8cec-4adbfbc3ec01 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:51.256421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a4673-739a-4271-8cec-4adbfbc3ec01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:51.258029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-320a4673-739a-4271-8cec-4adbfbc3ec01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:51.306873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:51.352373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a4673-739a-4271-8cec-4adbfbc3ec01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:51.353358 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a4673-739a-4271-8cec-4adbfbc3ec01 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:51.372348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 714/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:52.262067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46c31-8516-48ed-a1d1-92b41d647b52 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:52.262621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46c31-8516-48ed-a1d1-92b41d647b52 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:52.262621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46c31-8516-48ed-a1d1-92b41d647b52 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:52.264150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:52.269127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29d0de-97a1-4b6d-ac9a-a5fa899d4c52 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:52.269638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29d0de-97a1-4b6d-ac9a-a5fa899d4c52 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:52.269744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29d0de-97a1-4b6d-ac9a-a5fa899d4c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:52.351574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-cb29d0de-97a1-4b6d-ac9a-a5fa899d4c52 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:52.352803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cb29d0de-97a1-4b6d-ac9a-a5fa899d4c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:52.453802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:52.609173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46c31-8516-48ed-a1d1-92b41d647b52 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:52.610768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-22f46c31-8516-48ed-a1d1-92b41d647b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:52.662553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:52.762673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46c31-8516-48ed-a1d1-92b41d647b52 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:52.879724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a990fb-2adf-4ca0-9295-f38c1fe1215e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:52.880244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a990fb-2adf-4ca0-9295-f38c1fe1215e service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:52.880520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a990fb-2adf-4ca0-9295-f38c1fe1215e service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:52.880790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a990fb-2adf-4ca0-9295-f38c1fe1215e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:52.882435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e3a990fb-2adf-4ca0-9295-f38c1fe1215e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:52.890274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:52.972669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a990fb-2adf-4ca0-9295-f38c1fe1215e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:52.974286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a990fb-2adf-4ca0-9295-f38c1fe1215e service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:52.992951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 716/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:54.023562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542028-8f34-4d41-bdd1-374d05c15854 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:54.024160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542028-8f34-4d41-bdd1-374d05c15854 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:54.024160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542028-8f34-4d41-bdd1-374d05c15854 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:54.025516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:54.030701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49a7b-f541-4fe5-8bc8-13e206260ac4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:54.031195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49a7b-f541-4fe5-8bc8-13e206260ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:54.031306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49a7b-f541-4fe5-8bc8-13e206260ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:54.108297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-30d49a7b-f541-4fe5-8bc8-13e206260ac4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:54.109530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-30d49a7b-f541-4fe5-8bc8-13e206260ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:54.178718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:54.208569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:54.372477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76542028-8f34-4d41-bdd1-374d05c15854 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:54.373988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-76542028-8f34-4d41-bdd1-374d05c15854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:54.392643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:54.522777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76542028-8f34-4d41-bdd1-374d05c15854 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:54.611592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:54.637889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6512ba5-e526-43cc-86ae-7d872a67fb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:54.638702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6512ba5-e526-43cc-86ae-7d872a67fb03 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:54.639171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6512ba5-e526-43cc-86ae-7d872a67fb03 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:54.639756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6512ba5-e526-43cc-86ae-7d872a67fb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:54.641474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f6512ba5-e526-43cc-86ae-7d872a67fb03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:54.733589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6512ba5-e526-43cc-86ae-7d872a67fb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:54.735225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6512ba5-e526-43cc-86ae-7d872a67fb03 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:54.753684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 717/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:55.624894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2095da-75d2-455e-9792-d9cc92773cc1 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:55.625442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2095da-75d2-455e-9792-d9cc92773cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:55.625442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2095da-75d2-455e-9792-d9cc92773cc1 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:55.626720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:55.631763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64105ec-d3d5-4db2-b368-d96c345a5616 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:55.632207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64105ec-d3d5-4db2-b368-d96c345a5616 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:55.632335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64105ec-d3d5-4db2-b368-d96c345a5616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:55.708881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b64105ec-d3d5-4db2-b368-d96c345a5616 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:55.710102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b64105ec-d3d5-4db2-b368-d96c345a5616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:55.751816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:55.807714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:55.958081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2095da-75d2-455e-9792-d9cc92773cc1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:55.959596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9d2095da-75d2-455e-9792-d9cc92773cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:56.109237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2095da-75d2-455e-9792-d9cc92773cc1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:56.166036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:56.225473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a90f30-eb94-4b29-b10f-be9b5bdfb5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:56.225987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90f30-eb94-4b29-b10f-be9b5bdfb5b6 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:56.226272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90f30-eb94-4b29-b10f-be9b5bdfb5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:56.226548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90f30-eb94-4b29-b10f-be9b5bdfb5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:56.228199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c3a90f30-eb94-4b29-b10f-be9b5bdfb5b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:56.329787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a90f30-eb94-4b29-b10f-be9b5bdfb5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:56.331441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a90f30-eb94-4b29-b10f-be9b5bdfb5b6 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:56.350757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 719/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:57.226247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ae8a-1310-4fb1-8bf0-dbc24f890972 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:57.226819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ae8a-1310-4fb1-8bf0-dbc24f890972 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:57.226819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ae8a-1310-4fb1-8bf0-dbc24f890972 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:57.228221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:57.233153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005af27-6adb-4a0a-8594-df4b9aa503a4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:57.233614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005af27-6adb-4a0a-8594-df4b9aa503a4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:57.233712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005af27-6adb-4a0a-8594-df4b9aa503a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:57.311854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a005af27-6adb-4a0a-8594-df4b9aa503a4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:57.314012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a005af27-6adb-4a0a-8594-df4b9aa503a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:57.316234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:57.412048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:46:57.566772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739ae8a-1310-4fb1-8bf0-dbc24f890972 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:46:57.568383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2739ae8a-1310-4fb1-8bf0-dbc24f890972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:57.716569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739ae8a-1310-4fb1-8bf0-dbc24f890972 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:46:57.744556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:57.830872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3efd8-d699-4bfd-acaa-b497b4bda73b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:46:57.831400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3efd8-d699-4bfd-acaa-b497b4bda73b service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:57.831683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3efd8-d699-4bfd-acaa-b497b4bda73b service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:57.831956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3efd8-d699-4bfd-acaa-b497b4bda73b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:57.833573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d9c3efd8-d699-4bfd-acaa-b497b4bda73b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:57.924670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3efd8-d699-4bfd-acaa-b497b4bda73b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:46:57.926278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3efd8-d699-4bfd-acaa-b497b4bda73b service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:46:57.944617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 720/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:59.803670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d108-38b3-47df-b012-5b310b3b116c None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:59.804267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d108-38b3-47df-b012-5b310b3b116c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:59.804378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d108-38b3-47df-b012-5b310b3b116c None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:59.806195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:46:59.812050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f367d5-1993-4453-a26a-5fd559c4a1d4 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:46:59.812498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f367d5-1993-4453-a26a-5fd559c4a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:46:59.812621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f367d5-1993-4453-a26a-5fd559c4a1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:46:59.855136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:59.881187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-16f367d5-1993-4453-a26a-5fd559c4a1d4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:46:59.882436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-16f367d5-1993-4453-a26a-5fd559c4a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:46:59.983457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:00.270814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d108-38b3-47df-b012-5b310b3b116c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:00.272613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7552d108-38b3-47df-b012-5b310b3b116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:00.391564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d108-38b3-47df-b012-5b310b3b116c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:00.425398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:00.471070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1386f-08de-4d12-8cd4-8c7ee933f354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:00.471554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1386f-08de-4d12-8cd4-8c7ee933f354 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:00.471554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1386f-08de-4d12-8cd4-8c7ee933f354 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:00.472521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1386f-08de-4d12-8cd4-8c7ee933f354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:00.473531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3fb1386f-08de-4d12-8cd4-8c7ee933f354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:00.586810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1386f-08de-4d12-8cd4-8c7ee933f354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:00.588243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1386f-08de-4d12-8cd4-8c7ee933f354 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:00.607606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 722/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:02.685036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fdfc2-1474-491f-9169-77270bf36db9 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:02.685610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fdfc2-1474-491f-9169-77270bf36db9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:02.685610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fdfc2-1474-491f-9169-77270bf36db9 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:02.686939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:47:02.692498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e5e8-b85e-4d95-a45a-9fdac8caa7d5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:02.693847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e5e8-b85e-4d95-a45a-9fdac8caa7d5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:02.693847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e5e8-b85e-4d95-a45a-9fdac8caa7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:02.769547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-10d5e5e8-b85e-4d95-a45a-9fdac8caa7d5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:02.771055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-10d5e5e8-b85e-4d95-a45a-9fdac8caa7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:02.787409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:02.872277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:03.164553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fdfc2-1474-491f-9169-77270bf36db9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:03.166687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6e3fdfc2-1474-491f-9169-77270bf36db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:03.271101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fdfc2-1474-491f-9169-77270bf36db9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:03.284269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:03.350796 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292c1e-c1d9-4cc3-b07a-cc87abe3cf07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:03.351451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292c1e-c1d9-4cc3-b07a-cc87abe3cf07 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:03.351734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292c1e-c1d9-4cc3-b07a-cc87abe3cf07 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:03.352009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292c1e-c1d9-4cc3-b07a-cc87abe3cf07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:03.354291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-09292c1e-c1d9-4cc3-b07a-cc87abe3cf07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:03.462836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292c1e-c1d9-4cc3-b07a-cc87abe3cf07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:03.464250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292c1e-c1d9-4cc3-b07a-cc87abe3cf07 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:03.483729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 723/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:05.778879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558043-bab3-47e2-8581-16f560cbb7f8 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:05.779458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558043-bab3-47e2-8581-16f560cbb7f8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:05.779458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558043-bab3-47e2-8581-16f560cbb7f8 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:05.780844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:05.786487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc717-b50a-4cee-9834-a6eee4e5f943 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:05.787026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc717-b50a-4cee-9834-a6eee4e5f943 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:05.787026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc717-b50a-4cee-9834-a6eee4e5f943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:05.837387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:05.856654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-59bfc717-b50a-4cee-9834-a6eee4e5f943 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:05.857908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-59bfc717-b50a-4cee-9834-a6eee4e5f943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:05.955701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:06.236080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558043-bab3-47e2-8581-16f560cbb7f8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:06.237698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9a558043-bab3-47e2-8581-16f560cbb7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:06.342128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558043-bab3-47e2-8581-16f560cbb7f8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:06.381768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:06.422925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833dc7-f9e9-4765-9256-d835d6bf2100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:06.423553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833dc7-f9e9-4765-9256-d835d6bf2100 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:06.423832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833dc7-f9e9-4765-9256-d835d6bf2100 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:06.424100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833dc7-f9e9-4765-9256-d835d6bf2100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:06.425708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-86833dc7-f9e9-4765-9256-d835d6bf2100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:06.655912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833dc7-f9e9-4765-9256-d835d6bf2100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:06.657391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833dc7-f9e9-4765-9256-d835d6bf2100 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:06.675316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 725/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:47:08.723249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d7f6d-bbc1-40e5-b4ce-f7afa638c97e None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:08.723829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d7f6d-bbc1-40e5-b4ce-f7afa638c97e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:08.723829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d7f6d-bbc1-40e5-b4ce-f7afa638c97e None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:08.725114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:08.731287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77646173-9186-4697-aa6a-4c5f1727d3f9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:08.731815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77646173-9186-4697-aa6a-4c5f1727d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:08.731920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77646173-9186-4697-aa6a-4c5f1727d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:08.797798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-77646173-9186-4697-aa6a-4c5f1727d3f9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:08.799021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-77646173-9186-4697-aa6a-4c5f1727d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:08.820313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:08.894341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:09.183459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d7f6d-bbc1-40e5-b4ce-f7afa638c97e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:09.185027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-998d7f6d-bbc1-40e5-b4ce-f7afa638c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:09.288412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d7f6d-bbc1-40e5-b4ce-f7afa638c97e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:09.311903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:09.368717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8a038-9a95-41a4-9375-b68926a94a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:09.369336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a038-9a95-41a4-9375-b68926a94a28 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:09.369620 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a038-9a95-41a4-9375-b68926a94a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:09.369893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8a038-9a95-41a4-9375-b68926a94a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:09.371566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-51d8a038-9a95-41a4-9375-b68926a94a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:09.487768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8a038-9a95-41a4-9375-b68926a94a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:09.489174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8a038-9a95-41a4-9375-b68926a94a28 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:09.508521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 726/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:11.473831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17a48-b890-431f-8774-cd85ff464803 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:11.474392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17a48-b890-431f-8774-cd85ff464803 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:11.474392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17a48-b890-431f-8774-cd85ff464803 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:11.475873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:47:11.482121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de859cf-5c33-4755-ad67-2c989f666749 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:11.482570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de859cf-5c33-4755-ad67-2c989f666749 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:11.482799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de859cf-5c33-4755-ad67-2c989f666749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:11.547022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:11.549961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0de859cf-5c33-4755-ad67-2c989f666749 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:11.551201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0de859cf-5c33-4755-ad67-2c989f666749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:11.647848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:11.930564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f17a48-b890-431f-8774-cd85ff464803 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:11.932183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-63f17a48-b890-431f-8774-cd85ff464803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:12.035175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f17a48-b890-431f-8774-cd85ff464803 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:12.087622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:12.112597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f547c2-14f6-40f2-83fc-b706146b7d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:12.113208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f547c2-14f6-40f2-83fc-b706146b7d37 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:12.113490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f547c2-14f6-40f2-83fc-b706146b7d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:12.113862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f547c2-14f6-40f2-83fc-b706146b7d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:12.115589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c2f547c2-14f6-40f2-83fc-b706146b7d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:12.230414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f547c2-14f6-40f2-83fc-b706146b7d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:12.231802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f547c2-14f6-40f2-83fc-b706146b7d37 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:12.251146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 728/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:14.212628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118dff-4576-4978-93cb-91bfb088c7b6 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:14.213248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118dff-4576-4978-93cb-91bfb088c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:14.213248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118dff-4576-4978-93cb-91bfb088c7b6 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:14.214528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:14.219788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccf325-424d-4a91-8d6d-9b094c607f4c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:14.220203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccf325-424d-4a91-8d6d-9b094c607f4c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:14.220313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccf325-424d-4a91-8d6d-9b094c607f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:14.284787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-05ccf325-424d-4a91-8d6d-9b094c607f4c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:14.285984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-05ccf325-424d-4a91-8d6d-9b094c607f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:14.315062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:14.384809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:14.673141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118dff-4576-4978-93cb-91bfb088c7b6 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:14.674727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-16118dff-4576-4978-93cb-91bfb088c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:14.785838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118dff-4576-4978-93cb-91bfb088c7b6 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:14.814605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:14.860094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc211-289d-48e5-af1c-5f1f553830c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:14.860698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc211-289d-48e5-af1c-5f1f553830c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:14.860982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc211-289d-48e5-af1c-5f1f553830c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:14.861254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc211-289d-48e5-af1c-5f1f553830c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:14.862868 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-48ecc211-289d-48e5-af1c-5f1f553830c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:14.969673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc211-289d-48e5-af1c-5f1f553830c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:14.971037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc211-289d-48e5-af1c-5f1f553830c8 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:14.990296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 729/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:16.926433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8447dc-ffb4-47cb-8e75-2d1cc464f198 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:16.926974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8447dc-ffb4-47cb-8e75-2d1cc464f198 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:16.926974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8447dc-ffb4-47cb-8e75-2d1cc464f198 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:16.928376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:16.934295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b225b-a936-4d56-91ec-eb5e9f3edd30 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:16.934686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b225b-a936-4d56-91ec-eb5e9f3edd30 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:16.934830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b225b-a936-4d56-91ec-eb5e9f3edd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:17.004594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-956b225b-a936-4d56-91ec-eb5e9f3edd30 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:17.007245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-956b225b-a936-4d56-91ec-eb5e9f3edd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:17.014788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:17.103991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:17.394298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8447dc-ffb4-47cb-8e75-2d1cc464f198 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:17.396175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ae8447dc-ffb4-47cb-8e75-2d1cc464f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:17.507631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8447dc-ffb4-47cb-8e75-2d1cc464f198 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:17.572606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:17.597858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceee21-7831-46e4-b1f9-7dde52f6558f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:17.598517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceee21-7831-46e4-b1f9-7dde52f6558f service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:17.598743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceee21-7831-46e4-b1f9-7dde52f6558f service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:17.599016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceee21-7831-46e4-b1f9-7dde52f6558f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:17.600935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-72ceee21-7831-46e4-b1f9-7dde52f6558f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:17.735504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceee21-7831-46e4-b1f9-7dde52f6558f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:17.736948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceee21-7831-46e4-b1f9-7dde52f6558f service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:17.759545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 731/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:19.758019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e6d74-00ce-46b4-a83c-ae1a21190c5f None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:19.758586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e6d74-00ce-46b4-a83c-ae1a21190c5f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:19.758696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e6d74-00ce-46b4-a83c-ae1a21190c5f None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:19.760695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:19.766336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32409a-dae8-4b78-b524-83d030669101 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:19.766797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32409a-dae8-4b78-b524-83d030669101 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:19.766906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32409a-dae8-4b78-b524-83d030669101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:19.832620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7a32409a-dae8-4b78-b524-83d030669101 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:19.833818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7a32409a-dae8-4b78-b524-83d030669101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:19.871061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:19.929891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:20.208829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e6d74-00ce-46b4-a83c-ae1a21190c5f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:20.210361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ae0e6d74-00ce-46b4-a83c-ae1a21190c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:20.315210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e6d74-00ce-46b4-a83c-ae1a21190c5f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:20.353352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:20.390837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa07f9-5a16-4796-891f-c9972b88a947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:20.391472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa07f9-5a16-4796-891f-c9972b88a947 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:20.391756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa07f9-5a16-4796-891f-c9972b88a947 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:20.392030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa07f9-5a16-4796-891f-c9972b88a947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:20.393647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b3aa07f9-5a16-4796-891f-c9972b88a947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:20.507290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa07f9-5a16-4796-891f-c9972b88a947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:20.509398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa07f9-5a16-4796-891f-c9972b88a947 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:20.528967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 732/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:22.463501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240f1f-f417-4528-8a2d-a2cb3730aebc None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:22.464101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240f1f-f417-4528-8a2d-a2cb3730aebc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:22.464101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240f1f-f417-4528-8a2d-a2cb3730aebc None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:22.465447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:22.471173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf74903-54b6-417c-a096-9b2617776929 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:22.471705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf74903-54b6-417c-a096-9b2617776929 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:22.471705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf74903-54b6-417c-a096-9b2617776929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:22.547448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-cbf74903-54b6-417c-a096-9b2617776929 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:22.548670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cbf74903-54b6-417c-a096-9b2617776929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:22.567117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:22.650656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:22.938386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8240f1f-f417-4528-8a2d-a2cb3730aebc None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:22.939961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a8240f1f-f417-4528-8a2d-a2cb3730aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:23.045783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8240f1f-f417-4528-8a2d-a2cb3730aebc None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:23.114964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:23.122594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258f1c7-c772-4891-b9d1-ed012a300d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:23.123205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258f1c7-c772-4891-b9d1-ed012a300d36 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:23.123517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258f1c7-c772-4891-b9d1-ed012a300d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:23.129140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258f1c7-c772-4891-b9d1-ed012a300d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:23.129140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6258f1c7-c772-4891-b9d1-ed012a300d36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:23.235137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258f1c7-c772-4891-b9d1-ed012a300d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:23.236523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258f1c7-c772-4891-b9d1-ed012a300d36 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:23.255654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 734/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:25.210528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd59f5-8df6-41ae-8034-e5ece875b8f1 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:25.211109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd59f5-8df6-41ae-8034-e5ece875b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:25.211109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd59f5-8df6-41ae-8034-e5ece875b8f1 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:25.212520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:25.217910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c3e6-0a9e-4c3d-9de9-86a47cda0e9a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:25.218410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c3e6-0a9e-4c3d-9de9-86a47cda0e9a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:25.218518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c3e6-0a9e-4c3d-9de9-86a47cda0e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:25.287119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6060c3e6-0a9e-4c3d-9de9-86a47cda0e9a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:25.288433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6060c3e6-0a9e-4c3d-9de9-86a47cda0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:25.339240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:25.389029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:25.671570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd59f5-8df6-41ae-8034-e5ece875b8f1 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:25.673206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-46fd59f5-8df6-41ae-8034-e5ece875b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:25.777496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd59f5-8df6-41ae-8034-e5ece875b8f1 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:25.824511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:25.849961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccad558-e2f4-4a34-ae36-0c669485fcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:25.850570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccad558-e2f4-4a34-ae36-0c669485fcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:25.850848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccad558-e2f4-4a34-ae36-0c669485fcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:25.851118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccad558-e2f4-4a34-ae36-0c669485fcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:25.852851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8ccad558-e2f4-4a34-ae36-0c669485fcc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:25.963349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccad558-e2f4-4a34-ae36-0c669485fcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:25.964818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccad558-e2f4-4a34-ae36-0c669485fcc0 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:25.983938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 735/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:35.387167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=22 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:35.981457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=66 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:45.816789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad915c8e-9e4e-406d-92d5-90233e3c0be6 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.817415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad915c8e-9e4e-406d-92d5-90233e3c0be6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.817415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad915c8e-9e4e-406d-92d5-90233e3c0be6 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.818717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 736/1471] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:47:45.824730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f97312-8031-4a25-8c87-9237a69b83cf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:45.825258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f97312-8031-4a25-8c87-9237a69b83cf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:45.825357 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f97312-8031-4a25-8c87-9237a69b83cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:45.897256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-29f97312-8031-4a25-8c87-9237a69b83cf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:45.898524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-29f97312-8031-4a25-8c87-9237a69b83cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:45.998403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 736/1472] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:46.297415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22574-f02c-4655-b114-29398c789ae4 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.297695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22574-f02c-4655-b114-29398c789ae4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.298006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22574-f02c-4655-b114-29398c789ae4 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.299313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 737/1473] 10.222.0.62 () {54 vars in 967 bytes} [Thu Aug 18 20:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:46.305565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ddaa-0239-4bda-9475-a5251d10c0af None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.305846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ddaa-0239-4bda-9475-a5251d10c0af None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.306126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ddaa-0239-4bda-9475-a5251d10c0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.402225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f014ddaa-0239-4bda-9475-a5251d10c0af None None] MFA Rules not processed for user `c1f59dfd806f4d1cada6a42f5fce3b27`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:46.403495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f014ddaa-0239-4bda-9475-a5251d10c0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:46.426364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:46.491494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 737/1474] 10.222.0.62 () {58 vars in 1064 bytes} [Thu Aug 18 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:46.500344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22574-f02c-4655-b114-29398c789ae4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:46.502117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0dc22574-f02c-4655-b114-29398c789ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:46.646796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22574-f02c-4655-b114-29398c789ae4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:46.766610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c5b6-e45e-4d27-b3d7-463c234b3743 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:46.767223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c5b6-e45e-4d27-b3d7-463c234b3743 service glance] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:46.767533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c5b6-e45e-4d27-b3d7-463c234b3743 service glance] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:46.767808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c5b6-e45e-4d27-b3d7-463c234b3743 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:46.769439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5466c5b6-e45e-4d27-b3d7-463c234b3743 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:46.834706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:46.911446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c5b6-e45e-4d27-b3d7-463c234b3743 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:46.912810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c5b6-e45e-4d27-b3d7-463c234b3743 service glance] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:46.931387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 738/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:48.974175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb2c5-0581-4995-a72f-62d7b89bced2 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.974709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb2c5-0581-4995-a72f-62d7b89bced2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.974709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb2c5-0581-4995-a72f-62d7b89bced2 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:48.976290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 738/1476] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:48.981777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c60b2-0d70-4f0b-a4f0-d0e9a8b5268c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:48.982239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c60b2-0d70-4f0b-a4f0-d0e9a8b5268c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:48.982337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c60b2-0d70-4f0b-a4f0-d0e9a8b5268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.054860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-334c60b2-0d70-4f0b-a4f0-d0e9a8b5268c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:49.056137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-334c60b2-0d70-4f0b-a4f0-d0e9a8b5268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:49.155403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 739/1477] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:47:49.433594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfb2c5-0581-4995-a72f-62d7b89bced2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:49.435189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-dfdfb2c5-0581-4995-a72f-62d7b89bced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:49.566119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfb2c5-0581-4995-a72f-62d7b89bced2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:49.618929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:49.666967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffc4df-de77-415e-ae10-e914ff493197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:49.667610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffc4df-de77-415e-ae10-e914ff493197 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:49.667891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffc4df-de77-415e-ae10-e914ff493197 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:49.668162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffc4df-de77-415e-ae10-e914ff493197 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:49.668812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffc4df-de77-415e-ae10-e914ff493197 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:49.670557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-63ffc4df-de77-415e-ae10-e914ff493197 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:47:49.670557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:47:49.670557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:47:49.671748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffc4df-de77-415e-ae10-e914ff493197 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:49.691660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 739/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Aug 18 20:47:49 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:47:51.681015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03739cd-25f0-42e2-80bc-774b08276f64 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.681562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03739cd-25f0-42e2-80bc-774b08276f64 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.681562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03739cd-25f0-42e2-80bc-774b08276f64 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.682847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 740/1479] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:51.688117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8e84a-9bb7-4072-bfc2-ca102ae54247 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:51.688570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8e84a-9bb7-4072-bfc2-ca102ae54247 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:51.688675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8e84a-9bb7-4072-bfc2-ca102ae54247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:51.757022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d8f8e84a-9bb7-4072-bfc2-ca102ae54247 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:51.758847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d8f8e84a-9bb7-4072-bfc2-ca102ae54247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:51.861893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 740/1480] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:47:52.187525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03739cd-25f0-42e2-80bc-774b08276f64 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:52.189164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f03739cd-25f0-42e2-80bc-774b08276f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:52.207793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:52.353353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03739cd-25f0-42e2-80bc-774b08276f64 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:52.434893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:52.469790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2bdd6-8196-4ab9-921c-817eb0a67856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:52.470514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2bdd6-8196-4ab9-921c-817eb0a67856 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:52.470850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2bdd6-8196-4ab9-921c-817eb0a67856 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:52.471479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2bdd6-8196-4ab9-921c-817eb0a67856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:52.473142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-33c2bdd6-8196-4ab9-921c-817eb0a67856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:52.565353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2bdd6-8196-4ab9-921c-817eb0a67856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:52.566933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2bdd6-8196-4ab9-921c-817eb0a67856 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:52.584307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 741/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:54.753297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b099-9146-4d5c-b548-faee8a79aff9 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:54.753859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b099-9146-4d5c-b548-faee8a79aff9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:54.753859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b099-9146-4d5c-b548-faee8a79aff9 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:54.755189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 741/1482] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:54.760702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633399-3af6-45f8-a248-519cf29227da None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:54.761289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633399-3af6-45f8-a248-519cf29227da None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:54.761289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633399-3af6-45f8-a248-519cf29227da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:54.843950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-13633399-3af6-45f8-a248-519cf29227da None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:54.845941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-13633399-3af6-45f8-a248-519cf29227da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:54.897023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:54.949021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 742/1483] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:55.252430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b099-9146-4d5c-b548-faee8a79aff9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:55.253980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8ac8b099-9146-4d5c-b548-faee8a79aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:55.279167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:55.371741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b099-9146-4d5c-b548-faee8a79aff9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:55.481953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f3368-9a43-4117-9630-20dd9accd38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:55.482568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3368-9a43-4117-9630-20dd9accd38d service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:55.482847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3368-9a43-4117-9630-20dd9accd38d service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:55.483127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3368-9a43-4117-9630-20dd9accd38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:55.484774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d11f3368-9a43-4117-9630-20dd9accd38d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:55.560479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:55.597404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3368-9a43-4117-9630-20dd9accd38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:55.598906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3368-9a43-4117-9630-20dd9accd38d service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:55.619440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 742/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:47:57.621865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a009-b949-4f4c-8adc-9a73f58045f6 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.622400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a009-b949-4f4c-8adc-9a73f58045f6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.622400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a009-b949-4f4c-8adc-9a73f58045f6 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.623718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 743/1485] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:47:57.628910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87bc7-c3e0-4b03-97fe-3c2936acbc05 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:57.629350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87bc7-c3e0-4b03-97fe-3c2936acbc05 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:57.629510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87bc7-c3e0-4b03-97fe-3c2936acbc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:57.697078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3fc87bc7-c3e0-4b03-97fe-3c2936acbc05 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:47:57.698281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3fc87bc7-c3e0-4b03-97fe-3c2936acbc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:57.792599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 743/1486] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:47:58.080980 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5a009-b949-4f4c-8adc-9a73f58045f6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:47:58.082575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-41f5a009-b949-4f4c-8adc-9a73f58045f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:58.198511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5a009-b949-4f4c-8adc-9a73f58045f6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:47:58.270575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:58.272419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa42b3-efb9-45ee-9a0e-d0a64aeb5c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:47:58.273031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa42b3-efb9-45ee-9a0e-d0a64aeb5c9a service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:47:58.273313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa42b3-efb9-45ee-9a0e-d0a64aeb5c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:47:58.273613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa42b3-efb9-45ee-9a0e-d0a64aeb5c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:47:58.275239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-78fa42b3-efb9-45ee-9a0e-d0a64aeb5c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:47:58.387295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa42b3-efb9-45ee-9a0e-d0a64aeb5c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:47:58.388781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa42b3-efb9-45ee-9a0e-d0a64aeb5c9a service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:47:58.407586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 744/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:00.500781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192241-7230-4edf-bf67-ba557661a57a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.501361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192241-7230-4edf-bf67-ba557661a57a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.501361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192241-7230-4edf-bf67-ba557661a57a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.502699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 744/1488] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:48:00.508702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7759f1-8475-4726-ae8d-fb1c418a003a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:00.509185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7759f1-8475-4726-ae8d-fb1c418a003a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:00.509299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7759f1-8475-4726-ae8d-fb1c418a003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:00.587572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7a7759f1-8475-4726-ae8d-fb1c418a003a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:00.590986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7a7759f1-8475-4726-ae8d-fb1c418a003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:00.643766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:00.689620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 745/1489] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:00.987100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b192241-7230-4edf-bf67-ba557661a57a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:00.988672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6b192241-7230-4edf-bf67-ba557661a57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:01.025212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:01.099555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b192241-7230-4edf-bf67-ba557661a57a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:01.173683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dde46b-d647-4b05-90f1-7d3e88553bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:01.174293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde46b-d647-4b05-90f1-7d3e88553bac service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:01.174574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde46b-d647-4b05-90f1-7d3e88553bac service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:01.174846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde46b-d647-4b05-90f1-7d3e88553bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:01.176538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f0dde46b-d647-4b05-90f1-7d3e88553bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:01.268251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:01.296080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dde46b-d647-4b05-90f1-7d3e88553bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:01.297535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dde46b-d647-4b05-90f1-7d3e88553bac service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:01.317010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 745/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:03.687056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fc167-d117-4d13-96ea-903efa2510a2 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:03.687597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fc167-d117-4d13-96ea-903efa2510a2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:03.687597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fc167-d117-4d13-96ea-903efa2510a2 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:03.688907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 746/1491] 10.222.0.62 () {54 vars in 927 bytes} [Thu Aug 18 20:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:48:03.694355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80080e-0a3c-457e-b583-7d8d9c2e783d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:03.695312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80080e-0a3c-457e-b583-7d8d9c2e783d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:03.695457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80080e-0a3c-457e-b583-7d8d9c2e783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:03.763877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5e80080e-0a3c-457e-b583-7d8d9c2e783d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:48:03.765127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5e80080e-0a3c-457e-b583-7d8d9c2e783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:03.861579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 746/1492] 10.222.0.62 () {58 vars in 1024 bytes} [Thu Aug 18 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:48:04.156371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fc167-d117-4d13-96ea-903efa2510a2 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:48:04.157996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d19fc167-d117-4d13-96ea-903efa2510a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.262814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fc167-d117-4d13-96ea-903efa2510a2 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:48:04.337655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648e8d-abf0-44aa-a4f0-8dbb32d607e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:48:04.338258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648e8d-abf0-44aa-a4f0-8dbb32d607e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:48:04.338534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648e8d-abf0-44aa-a4f0-8dbb32d607e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:48:04.338805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648e8d-abf0-44aa-a4f0-8dbb32d607e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:48:04.340434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6c648e8d-abf0-44aa-a4f0-8dbb32d607e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:48:04.349949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:04.450505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c648e8d-abf0-44aa-a4f0-8dbb32d607e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:48:04.451900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c648e8d-abf0-44aa-a4f0-8dbb32d607e7 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:48:04.470154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 747/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:48:13.859699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=82 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:48:14.467790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=50 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:26.418564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:26.419063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:26.419168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:26.493511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:26.494720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:26.592097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 747/1494] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:26.600265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a11da-56cc-46ba-8af3-a28c098ec6f8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:26.600765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a11da-56cc-46ba-8af3-a28c098ec6f8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:26.600765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a11da-56cc-46ba-8af3-a28c098ec6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:26.675484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-bd0a11da-56cc-46ba-8af3-a28c098ec6f8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:26.676690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bd0a11da-56cc-46ba-8af3-a28c098ec6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:26.773108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 748/1495] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:49:26.777813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:26.779064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:26.790482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dabd-4178-41aa-8112-c1fef62e7a13 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:26.851077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:26.884567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:26.885186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:26.885664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:26.886098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:26.886798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:49:26.887465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:26.888476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:26.888476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:49:26.888476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:49:26.889410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:26.900812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 748/1496] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:49:26.909132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a11da-56cc-46ba-8af3-a28c098ec6f8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:26.918120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a11da-56cc-46ba-8af3-a28c098ec6f8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:26.978193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:27.011545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:27.012142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:27.012417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:27.012683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:27.013295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:27.014992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING py.warnings [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:27.014992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: warnings.warn(msg) Aug 18 20:49:27.014992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: Aug 18 20:49:27.016232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:27.223493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 749/1497] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:49:26 2022] POST /identity/v3/projects => generated 379 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:27.227709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:27.229240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:27.261954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0602e-a41f-4f8a-9312-77fd243e9363 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:27.356721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:27.357308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:27.357583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:27.358487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:27.359124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:27.360171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:27.360171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:49:27.360171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:49:27.361377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:27.532291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 749/1498] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:49:27 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:49:27.536698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:27.538203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:27.599475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184b3c1-521a-4396-a65b-c1380685eead admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:27.681885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:27.692089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:27.692730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:27.693013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:27.693286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:27.693939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:27.694992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING py.warnings [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:27.694992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: warnings.warn(msg) Aug 18 20:49:27.694992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: Aug 18 20:49:27.695869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:27.708842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 750/1499] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:27.712977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:27.714544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:27.726908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46f8a-9f5a-484b-a8e7-ba4fbbfbb854 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:27.757624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:27.828906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa332-8308-4e1c-9599-0dffeb9d8f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:27.829426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa332-8308-4e1c-9599-0dffeb9d8f11 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:27.829708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa332-8308-4e1c-9599-0dffeb9d8f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:27.829984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa332-8308-4e1c-9599-0dffeb9d8f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:27.830634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aa332-8308-4e1c-9599-0dffeb9d8f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:27.831675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-682aa332-8308-4e1c-9599-0dffeb9d8f11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:27.831675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:49:27.831675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:49:27.832577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aa332-8308-4e1c-9599-0dffeb9d8f11 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:27.845314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 750/1500] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:49:27.849606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:27.851208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:27.884685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08eab9-c948-4e23-8043-07ec67248abe admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:27.977446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf0cc9-9549-4c13-842a-d2e8c99330f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:27.978093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0cc9-9549-4c13-842a-d2e8c99330f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:27.978370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0cc9-9549-4c13-842a-d2e8c99330f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:27.978641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0cc9-9549-4c13-842a-d2e8c99330f4 admin admin] PATH_INFO: `/v3/projects/6a4043c2f21849acb3a3f32107ca17a0/users/a43fb6d4afbb4986b9401e9fedaca070/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:28.000535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf0cc9-9549-4c13-842a-d2e8c99330f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4043c2f21849acb3a3f32107ca17a0, user_id=a43fb6d4afbb4986b9401e9fedaca070, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:28.001557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING py.warnings [None req-3fcf0cc9-9549-4c13-842a-d2e8c99330f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:28.001557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: warnings.warn(msg) Aug 18 20:49:28.001557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: Aug 18 20:49:28.003542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf0cc9-9549-4c13-842a-d2e8c99330f4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:28.096262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 751/1501] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:49:27 2022] PUT /identity/v3/projects/6a4043c2f21849acb3a3f32107ca17a0/users/a43fb6d4afbb4986b9401e9fedaca070/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:28.111211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209e4d-94b0-4f32-ba57-84566e1c5c67 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:28.111539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209e4d-94b0-4f32-ba57-84566e1c5c67 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:28.111823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209e4d-94b0-4f32-ba57-84566e1c5c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:28.168612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e1209e4d-94b0-4f32-ba57-84566e1c5c67 None None] MFA Rules not processed for user `a43fb6d4afbb4986b9401e9fedaca070`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:28.169831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e1209e4d-94b0-4f32-ba57-84566e1c5c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:28.247180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 751/1502] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:28.261066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf1f4-7c17-4c0b-8fb9-919b9108bb21 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:28.261347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf1f4-7c17-4c0b-8fb9-919b9108bb21 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:28.261612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf1f4-7c17-4c0b-8fb9-919b9108bb21 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:28.262972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 752/1503] 10.222.0.62 () {54 vars in 964 bytes} [Thu Aug 18 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:49:28.268457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3115-5784-435b-b7cf-87db92f460c7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:28.268791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3115-5784-435b-b7cf-87db92f460c7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:28.269124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3115-5784-435b-b7cf-87db92f460c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:28.300713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:28.346008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bdef3115-5784-435b-b7cf-87db92f460c7 None None] MFA Rules not processed for user `b743dbcea55f4ab7b339eb7dc6e30630`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:28.347275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bdef3115-5784-435b-b7cf-87db92f460c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:28.423900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 752/1504] 10.222.0.62 () {58 vars in 1061 bytes} [Thu Aug 18 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:28.431870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaf1f4-7c17-4c0b-8fb9-919b9108bb21 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:28.433478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4acaf1f4-7c17-4c0b-8fb9-919b9108bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:28.483597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:28.537036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaf1f4-7c17-4c0b-8fb9-919b9108bb21 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:28.611265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:28.611999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:28.612121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:28.612497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:28.613966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:28.718816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:28.720004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:28.723562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:28.738507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 753/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:28.784664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4f568-a27a-4a48-ae3e-3167f63ea3ba None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:28.785102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4f568-a27a-4a48-ae3e-3167f63ea3ba None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:28.785258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4f568-a27a-4a48-ae3e-3167f63ea3ba None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:28.786490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 753/1506] 10.222.0.62 () {52 vars in 830 bytes} [Thu Aug 18 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:49:28.790090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:28.791304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:28.890128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e055d93-6c54-4162-9994-e3411f3a9e8b service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:28.982371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:28.983000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:28.983852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:28.984127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] PATH_INFO: `/v3/users/a43fb6d4afbb4986b9401e9fedaca070` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:28.996047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43fb6d4afbb4986b9401e9fedaca070)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:28.997064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING py.warnings [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:28.997064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: warnings.warn(msg) Aug 18 20:49:28.997064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: Aug 18 20:49:28.998299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:29.007815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:29.208692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43fb6d4afbb4986b9401e9fedaca070'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:29.209056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43fb6d4afbb4986b9401e9fedaca070'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:29.223991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43fb6d4afbb4986b9401e9fedaca070'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:29.224542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43fb6d4afbb4986b9401e9fedaca070'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:29.246836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43fb6d4afbb4986b9401e9fedaca070'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:29.357129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 754/1507] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:49:28 2022] DELETE /identity/v3/users/a43fb6d4afbb4986b9401e9fedaca070 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:29.361426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42072b-8e90-457d-acea-806635f1574c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:29.361709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42072b-8e90-457d-acea-806635f1574c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:29.361981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42072b-8e90-457d-acea-806635f1574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:29.419730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bf42072b-8e90-457d-acea-806635f1574c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:49:29.420906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bf42072b-8e90-457d-acea-806635f1574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:29.496112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:29.508984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 754/1508] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:49:29.519353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:29.520933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:29.621496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b158e2-bb28-41df-a99b-450e6758683e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:29.675786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:29.694957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd97b6e-936a-4722-af16-f0ab7c87916b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:29.695612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97b6e-936a-4722-af16-f0ab7c87916b service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:29.695896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97b6e-936a-4722-af16-f0ab7c87916b service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:29.696175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97b6e-936a-4722-af16-f0ab7c87916b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:29.697843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0bd97b6e-936a-4722-af16-f0ab7c87916b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:29.806634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd97b6e-936a-4722-af16-f0ab7c87916b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:29.808108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd97b6e-936a-4722-af16-f0ab7c87916b service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:29.826819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 755/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:49:30.345718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42072b-8e90-457d-acea-806635f1574c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:49:30.350241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bf42072b-8e90-457d-acea-806635f1574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:49:30.359559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42072b-8e90-457d-acea-806635f1574c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:49:30.458653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:49:30.459282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:49:30.459596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:49:30.459875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] PATH_INFO: `/v3/projects/6a4043c2f21849acb3a3f32107ca17a0` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:49:30.470300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4043c2f21849acb3a3f32107ca17a0)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:49:30.471331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:49:30.471331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:49:30.471331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:49:30.472557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:49:30.596669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4043c2f21849acb3a3f32107ca17a0', 'request_id': 'req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.602558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4043c2f21849acb3a3f32107ca17a0', 'request_id': 'req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.682881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4043c2f21849acb3a3f32107ca17a0', 'request_id': 'req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.713492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] The token cache is being invalidate because project 6a4043c2f21849acb3a3f32107ca17a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:49:30.713828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.714364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f81913ac-e9c6-4be5-b35d-ffc96b9b6ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:49:30.715733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 755/1510] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:49:30 2022] DELETE /identity/v3/projects/6a4043c2f21849acb3a3f32107ca17a0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:49:39.824512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=62 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:49:40.711487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:04.895280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ccb9-a944-4613-b57c-5b80ee4c7aee None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:04.895954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ccb9-a944-4613-b57c-5b80ee4c7aee None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:04.895954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ccb9-a944-4613-b57c-5b80ee4c7aee None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:04.897346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:04.902306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ecc2d-19e8-4164-b655-bf7b90fae77f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:04.902733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ecc2d-19e8-4164-b655-bf7b90fae77f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:04.902863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ecc2d-19e8-4164-b655-bf7b90fae77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:04.987724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0f3ecc2d-19e8-4164-b655-bf7b90fae77f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:04.988952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0f3ecc2d-19e8-4164-b655-bf7b90fae77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:05.105733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:05.272246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69ccb9-a944-4613-b57c-5b80ee4c7aee None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:05.274576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-af69ccb9-a944-4613-b57c-5b80ee4c7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:05.402930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69ccb9-a944-4613-b57c-5b80ee4c7aee None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:05.409879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943a77c-7b96-455b-8101-78d6d8949792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:05.410516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943a77c-7b96-455b-8101-78d6d8949792 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:05.410800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943a77c-7b96-455b-8101-78d6d8949792 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:05.411074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943a77c-7b96-455b-8101-78d6d8949792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:05.419506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943a77c-7b96-455b-8101-78d6d8949792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:05.423715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943a77c-7b96-455b-8101-78d6d8949792 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:05.430876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 757/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:06.273869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c9f3-ed85-4e88-a32e-bfacd1e0c5ee None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:06.274448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c9f3-ed85-4e88-a32e-bfacd1e0c5ee None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:06.274448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c9f3-ed85-4e88-a32e-bfacd1e0c5ee None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:06.275864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:06.280806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cf57-2f28-4931-b3c8-2fe0a3c17ce5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:06.281234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cf57-2f28-4931-b3c8-2fe0a3c17ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:06.281394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cf57-2f28-4931-b3c8-2fe0a3c17ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:06.301331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-db39cf57-2f28-4931-b3c8-2fe0a3c17ce5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:06.302541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-db39cf57-2f28-4931-b3c8-2fe0a3c17ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:06.310640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:06.466869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c9f3-ed85-4e88-a32e-bfacd1e0c5ee None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:06.481731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c9f3-ed85-4e88-a32e-bfacd1e0c5ee None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:06.487763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df2dc8-3188-4e6d-bb40-39470d4b0348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:06.488376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df2dc8-3188-4e6d-bb40-39470d4b0348 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:06.488655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df2dc8-3188-4e6d-bb40-39470d4b0348 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:06.488928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df2dc8-3188-4e6d-bb40-39470d4b0348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:06.497620 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df2dc8-3188-4e6d-bb40-39470d4b0348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:06.499213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df2dc8-3188-4e6d-bb40-39470d4b0348 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:06.508864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 758/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:07.314880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ccc9-5116-409b-a586-e5155d93dd62 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:07.315520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ccc9-5116-409b-a586-e5155d93dd62 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:07.317630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ccc9-5116-409b-a586-e5155d93dd62 None None] PATH_INFO: `/v3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:07.318949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 759/1517] 10.222.0.55 () {54 vars in 925 bytes} [Thu Aug 18 20:51:07 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:07.327078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd58e-7939-4cc2-b5b9-079da4574da1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:07.327559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd58e-7939-4cc2-b5b9-079da4574da1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:07.327668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd58e-7939-4cc2-b5b9-079da4574da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:07.391206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1a1cd58e-7939-4cc2-b5b9-079da4574da1 None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:07.392489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1a1cd58e-7939-4cc2-b5b9-079da4574da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:07.410800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:07.467504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 759/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Aug 18 20:51:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:11.701002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b061ce-fe44-49a3-8655-5907ca4cde7d None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:11.701520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b061ce-fe44-49a3-8655-5907ca4cde7d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:11.701520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b061ce-fe44-49a3-8655-5907ca4cde7d None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:11.702808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 760/1519] 10.222.0.62 () {54 vars in 961 bytes} [Thu Aug 18 20:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:11.708392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271c16-8917-4995-83ff-900ff9a834d8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:11.708843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271c16-8917-4995-83ff-900ff9a834d8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:11.708957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271c16-8917-4995-83ff-900ff9a834d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:11.727890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b6271c16-8917-4995-83ff-900ff9a834d8 None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:11.729072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b6271c16-8917-4995-83ff-900ff9a834d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:11.737442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 760/1520] 10.222.0.62 () {58 vars in 1058 bytes} [Thu Aug 18 20:51:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:11.744738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b061ce-fe44-49a3-8655-5907ca4cde7d None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:11.758388 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b061ce-fe44-49a3-8655-5907ca4cde7d None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:11.763279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dfd29-8215-4bd2-b91c-db5cdfde4145 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:11.763907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dfd29-8215-4bd2-b91c-db5cdfde4145 service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:11.764187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dfd29-8215-4bd2-b91c-db5cdfde4145 service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:11.764460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dfd29-8215-4bd2-b91c-db5cdfde4145 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:11.773383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dfd29-8215-4bd2-b91c-db5cdfde4145 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:11.775208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dfd29-8215-4bd2-b91c-db5cdfde4145 service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:11.784678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 761/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:51:17.730986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693896e-908c-432e-9e09-006c1a39f812 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:17.731577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693896e-908c-432e-9e09-006c1a39f812 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:17.731577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693896e-908c-432e-9e09-006c1a39f812 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:17.732824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:17.737554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89651-7171-4389-9612-991d8adaa461 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:17.738002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89651-7171-4389-9612-991d8adaa461 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:17.738106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca89651-7171-4389-9612-991d8adaa461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:17.757914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-bca89651-7171-4389-9612-991d8adaa461 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:17.759199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bca89651-7171-4389-9612-991d8adaa461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:17.767075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:17.921222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693896e-908c-432e-9e09-006c1a39f812 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:17.935753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693896e-908c-432e-9e09-006c1a39f812 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:17.941156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037edef-712b-4ac8-93f0-6c17837e4c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:17.941764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037edef-712b-4ac8-93f0-6c17837e4c0e service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:17.942033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037edef-712b-4ac8-93f0-6c17837e4c0e service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:17.942304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037edef-712b-4ac8-93f0-6c17837e4c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:17.951016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037edef-712b-4ac8-93f0-6c17837e4c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:17.952656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037edef-712b-4ac8-93f0-6c17837e4c0e service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:17.962671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 762/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:18.781378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca40944-b154-4e03-8b06-dce90bb8b821 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:18.781927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca40944-b154-4e03-8b06-dce90bb8b821 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:18.781927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca40944-b154-4e03-8b06-dce90bb8b821 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:18.783279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:18.788170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22152a6-fef2-4235-ba63-5f80736310d7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:18.788613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22152a6-fef2-4235-ba63-5f80736310d7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:18.788718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22152a6-fef2-4235-ba63-5f80736310d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:18.809507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e22152a6-fef2-4235-ba63-5f80736310d7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:18.810725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e22152a6-fef2-4235-ba63-5f80736310d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:18.819277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:51:18.973914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca40944-b154-4e03-8b06-dce90bb8b821 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:18.988870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca40944-b154-4e03-8b06-dce90bb8b821 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:18.994903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66b4f3-7a6b-4db4-8512-45584b98e4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:18.995516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b4f3-7a6b-4db4-8512-45584b98e4ee service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:18.995795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b4f3-7a6b-4db4-8512-45584b98e4ee service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:18.996061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b4f3-7a6b-4db4-8512-45584b98e4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:19.004022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66b4f3-7a6b-4db4-8512-45584b98e4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:19.005591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66b4f3-7a6b-4db4-8512-45584b98e4ee service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:19.014810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 764/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:23.002412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a17c-5d8e-49df-9b1a-424a1709b35a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:23.002957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a17c-5d8e-49df-9b1a-424a1709b35a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:23.002957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a17c-5d8e-49df-9b1a-424a1709b35a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:23.004374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:23.010441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686c51-5045-43c0-83bf-3da14a1211a9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:23.010849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686c51-5045-43c0-83bf-3da14a1211a9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:23.010999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686c51-5045-43c0-83bf-3da14a1211a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:23.030923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-39686c51-5045-43c0-83bf-3da14a1211a9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:23.032157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-39686c51-5045-43c0-83bf-3da14a1211a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:23.040501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:23.326356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58a17c-5d8e-49df-9b1a-424a1709b35a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:23.328109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9b58a17c-5d8e-49df-9b1a-424a1709b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:23.422767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58a17c-5d8e-49df-9b1a-424a1709b35a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:23.426344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bed69-ddcc-4926-b9fd-a1ac96caebcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:23.426946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bed69-ddcc-4926-b9fd-a1ac96caebcf service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:23.427224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bed69-ddcc-4926-b9fd-a1ac96caebcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:23.427530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bed69-ddcc-4926-b9fd-a1ac96caebcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:23.436411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bed69-ddcc-4926-b9fd-a1ac96caebcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:23.437851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bed69-ddcc-4926-b9fd-a1ac96caebcf service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:23.447124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 765/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:25.341896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3f9c-af2e-4e76-b6a2-db9bf8b82682 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:25.342509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3f9c-af2e-4e76-b6a2-db9bf8b82682 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:25.342509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3f9c-af2e-4e76-b6a2-db9bf8b82682 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:25.343870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:25.349244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf43bd-a274-4ed5-a82b-1fa2f1534a3e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:25.349615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf43bd-a274-4ed5-a82b-1fa2f1534a3e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:25.349784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf43bd-a274-4ed5-a82b-1fa2f1534a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:25.368749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-facf43bd-a274-4ed5-a82b-1fa2f1534a3e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:25.370432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-facf43bd-a274-4ed5-a82b-1fa2f1534a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:25.378256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:25.672025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3f9c-af2e-4e76-b6a2-db9bf8b82682 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:25.683558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3f9c-af2e-4e76-b6a2-db9bf8b82682 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:25.687184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ce200-d8eb-4fcd-ad6d-6a4bbd8c7500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:25.687797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce200-d8eb-4fcd-ad6d-6a4bbd8c7500 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:25.688077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce200-d8eb-4fcd-ad6d-6a4bbd8c7500 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:25.688356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce200-d8eb-4fcd-ad6d-6a4bbd8c7500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:25.697431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ce200-d8eb-4fcd-ad6d-6a4bbd8c7500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:25.698865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ce200-d8eb-4fcd-ad6d-6a4bbd8c7500 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:25.708347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 767/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:29.356964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550a92-2d47-4966-bc76-42676157499a None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:29.357487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550a92-2d47-4966-bc76-42676157499a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:29.357586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550a92-2d47-4966-bc76-42676157499a None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:29.358859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:29.364558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77761613-4574-4ab7-9fe6-8657654c6780 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:29.364973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77761613-4574-4ab7-9fe6-8657654c6780 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:29.365099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77761613-4574-4ab7-9fe6-8657654c6780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:29.383988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-77761613-4574-4ab7-9fe6-8657654c6780 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:29.385205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-77761613-4574-4ab7-9fe6-8657654c6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:29.392960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:29.959431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550a92-2d47-4966-bc76-42676157499a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:29.961142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d9550a92-2d47-4966-bc76-42676157499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:30.027193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:30.039894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550a92-2d47-4966-bc76-42676157499a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:30.043481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6b2e3-c666-4d05-b003-30a06b85f8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:30.044082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6b2e3-c666-4d05-b003-30a06b85f8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:30.044359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6b2e3-c666-4d05-b003-30a06b85f8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:30.044627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6b2e3-c666-4d05-b003-30a06b85f8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:30.053500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6b2e3-c666-4d05-b003-30a06b85f8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:30.054927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6b2e3-c666-4d05-b003-30a06b85f8f8 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:30.064630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 768/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:32.035136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb488-433f-46f0-a52e-d86015d31aac None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:32.035735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb488-433f-46f0-a52e-d86015d31aac None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:32.035735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb488-433f-46f0-a52e-d86015d31aac None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:32.037113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:32.043068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cbba-d9f5-4221-badf-4ea1aab3e9ab None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:32.043546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cbba-d9f5-4221-badf-4ea1aab3e9ab None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:32.043661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cbba-d9f5-4221-badf-4ea1aab3e9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:32.063263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7410cbba-d9f5-4221-badf-4ea1aab3e9ab None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:32.064477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7410cbba-d9f5-4221-badf-4ea1aab3e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:32.072149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:51:32.626384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb488-433f-46f0-a52e-d86015d31aac None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:32.628088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7f6fb488-433f-46f0-a52e-d86015d31aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:32.635666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=84 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:32.641396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb488-433f-46f0-a52e-d86015d31aac None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:32.645279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd167ad-494c-456d-a6fd-e9c04bbaf618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:32.648500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd167ad-494c-456d-a6fd-e9c04bbaf618 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:32.648500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd167ad-494c-456d-a6fd-e9c04bbaf618 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:32.648500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd167ad-494c-456d-a6fd-e9c04bbaf618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:32.655630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd167ad-494c-456d-a6fd-e9c04bbaf618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:32.657070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd167ad-494c-456d-a6fd-e9c04bbaf618 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:32.667896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 770/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:51:42.058699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=11 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:42.668711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.424376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0327518-4385-49b5-b5ba-ff22e20a3ed8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.425141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0327518-4385-49b5-b5ba-ff22e20a3ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.425240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0327518-4385-49b5-b5ba-ff22e20a3ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.479665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e0327518-4385-49b5-b5ba-ff22e20a3ed8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.481930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e0327518-4385-49b5-b5ba-ff22e20a3ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:01.497469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 770/1540] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:01.517604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d10e05-4ebc-401e-b4f2-b7bfa3e7a343 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.518467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d10e05-4ebc-401e-b4f2-b7bfa3e7a343 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.518769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d10e05-4ebc-401e-b4f2-b7bfa3e7a343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.556319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-15d10e05-4ebc-401e-b4f2-b7bfa3e7a343 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.557547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-15d10e05-4ebc-401e-b4f2-b7bfa3e7a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:01.571671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 771/1541] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:01.583626 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0327518-4385-49b5-b5ba-ff22e20a3ed8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.601530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0327518-4385-49b5-b5ba-ff22e20a3ed8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.608993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54588c-77da-4980-96c4-44dd2048672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.610035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54588c-77da-4980-96c4-44dd2048672e admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.610564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54588c-77da-4980-96c4-44dd2048672e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.611063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54588c-77da-4980-96c4-44dd2048672e admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.613423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54588c-77da-4980-96c4-44dd2048672e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:01.614001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54588c-77da-4980-96c4-44dd2048672e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.616730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54588c-77da-4980-96c4-44dd2048672e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.638506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 771/1542] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:01.651069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d10e05-4ebc-401e-b4f2-b7bfa3e7a343 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.670029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d10e05-4ebc-401e-b4f2-b7bfa3e7a343 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.676488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee12dac-31bb-441d-8d75-d97e44ced869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.677196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee12dac-31bb-441d-8d75-d97e44ced869 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.677483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee12dac-31bb-441d-8d75-d97e44ced869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.677756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee12dac-31bb-441d-8d75-d97e44ced869 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.679062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee12dac-31bb-441d-8d75-d97e44ced869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.681065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee12dac-31bb-441d-8d75-d97e44ced869 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.686519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90454-4c99-4d11-8c2e-2908e103f0cd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.691679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90454-4c99-4d11-8c2e-2908e103f0cd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.691679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90454-4c99-4d11-8c2e-2908e103f0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.728630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c8c90454-4c99-4d11-8c2e-2908e103f0cd None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.730503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c8c90454-4c99-4d11-8c2e-2908e103f0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:01.748232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 772/1543] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:01.771720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2ed35-3587-42f8-b381-139dcf0d6c76 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.772527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2ed35-3587-42f8-b381-139dcf0d6c76 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.773038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2ed35-3587-42f8-b381-139dcf0d6c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.807392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-02e2ed35-3587-42f8-b381-139dcf0d6c76 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.809314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-02e2ed35-3587-42f8-b381-139dcf0d6c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:01.824934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 773/1544] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:01.831573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 772/1545] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:01.832648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2ed35-3587-42f8-b381-139dcf0d6c76 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.836841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1224-188f-423c-9fc5-b0f9b3b9d921 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.837190 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1224-188f-423c-9fc5-b0f9b3b9d921 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.837407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1224-188f-423c-9fc5-b0f9b3b9d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.849843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2ed35-3587-42f8-b381-139dcf0d6c76 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.872410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-addf1224-188f-423c-9fc5-b0f9b3b9d921 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.873613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-addf1224-188f-423c-9fc5-b0f9b3b9d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.018819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.019898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.020419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.020940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.027870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.029023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.030925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.049641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 774/1546] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:02.051142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.065537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 773/1547] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:02.066876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebcbd0-07c8-4338-bd99-ffac5313cb53 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.067163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebcbd0-07c8-4338-bd99-ffac5313cb53 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.071833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b55e-92c0-4961-9d30-004b39dec224 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.075389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebcbd0-07c8-4338-bd99-ffac5313cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.089720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03b2e0-af85-4ac1-bb6e-d9e6691c1733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.090810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b2e0-af85-4ac1-bb6e-d9e6691c1733 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.091344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b2e0-af85-4ac1-bb6e-d9e6691c1733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.091894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b2e0-af85-4ac1-bb6e-d9e6691c1733 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.092819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03b2e0-af85-4ac1-bb6e-d9e6691c1733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.095148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03b2e0-af85-4ac1-bb6e-d9e6691c1733 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.114434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-31ebcbd0-07c8-4338-bd99-ffac5313cb53 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.115824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-31ebcbd0-07c8-4338-bd99-ffac5313cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.137091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 774/1548] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.138393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebcbd0-07c8-4338-bd99-ffac5313cb53 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.151938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebcbd0-07c8-4338-bd99-ffac5313cb53 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.164174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.164884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.165171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.165441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.166089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.168083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.218117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 775/1549] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:02.220030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42d31b-242c-471c-a241-6b94fa401eaf None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.220565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42d31b-242c-471c-a241-6b94fa401eaf None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.221074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42d31b-242c-471c-a241-6b94fa401eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.246853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6f42d31b-242c-471c-a241-6b94fa401eaf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.248879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6f42d31b-242c-471c-a241-6b94fa401eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.259184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 776/1550] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.261084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed235d-dd18-43ec-85cb-b6033c9e180a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.261759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed235d-dd18-43ec-85cb-b6033c9e180a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.262679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed235d-dd18-43ec-85cb-b6033c9e180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.288597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6eed235d-dd18-43ec-85cb-b6033c9e180a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.290370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6eed235d-dd18-43ec-85cb-b6033c9e180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.301222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 777/1551] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.303179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaad6-3c68-4e32-92f8-3a7a118e7406 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.304862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaad6-3c68-4e32-92f8-3a7a118e7406 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.305452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaad6-3c68-4e32-92f8-3a7a118e7406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.328167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 775/1552] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:02.331976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.340194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3eefaad6-3c68-4e32-92f8-3a7a118e7406 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.341775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3eefaad6-3c68-4e32-92f8-3a7a118e7406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.448249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 778/1553] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.449623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaad6-3c68-4e32-92f8-3a7a118e7406 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.464950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaad6-3c68-4e32-92f8-3a7a118e7406 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.470079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2fce8-41ec-4e66-b526-2136546fadb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.470942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2fce8-41ec-4e66-b526-2136546fadb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.471234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2fce8-41ec-4e66-b526-2136546fadb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.471549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2fce8-41ec-4e66-b526-2136546fadb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.472252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2fce8-41ec-4e66-b526-2136546fadb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.472564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2fce8-41ec-4e66-b526-2136546fadb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.474288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2fce8-41ec-4e66-b526-2136546fadb1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.477371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab292-ec04-46b1-9aeb-8f283476a01f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.483427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.484075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.484371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.484646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.485473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.489023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.498363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 779/1554] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.498363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3bb12-ad34-425d-91dc-3f1daf33bb62 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.498363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3bb12-ad34-425d-91dc-3f1daf33bb62 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.498363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3bb12-ad34-425d-91dc-3f1daf33bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.516550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 776/1555] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:02.517424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.523950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-fba3bb12-ad34-425d-91dc-3f1daf33bb62 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.525179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-fba3bb12-ad34-425d-91dc-3f1daf33bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.533754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 780/1556] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.534910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a077-018d-4ff3-b596-d32bca92ea00 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.535197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a077-018d-4ff3-b596-d32bca92ea00 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.535517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a077-018d-4ff3-b596-d32bca92ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.538068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d267b-f8a2-4bb3-9e8d-dd501b948651 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.543075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.543731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.544013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.544290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.544932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.546099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING py.warnings [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:53:02.546099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: warnings.warn(msg) Aug 18 20:53:02.546099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: Aug 18 20:53:02.547344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.558404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b544a077-018d-4ff3-b596-d32bca92ea00 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.559125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b544a077-018d-4ff3-b596-d32bca92ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.567755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 781/1557] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.569721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00366c0-9058-4935-b2a5-ab5151430e8a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.570040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00366c0-9058-4935-b2a5-ab5151430e8a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.570458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00366c0-9058-4935-b2a5-ab5151430e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.583022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.610953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a00366c0-9058-4935-b2a5-ab5151430e8a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.612427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a00366c0-9058-4935-b2a5-ab5151430e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.623905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 782/1558] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.624795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00366c0-9058-4935-b2a5-ab5151430e8a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.639390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00366c0-9058-4935-b2a5-ab5151430e8a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.645779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.646412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.646695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.647596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.648268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.648574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.650363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.663684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 783/1559] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.677751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.677751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e7e8-d14d-4fc6-aa3a-235fe04a9b97 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.678801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f54232-6a25-4915-a029-4fdbe2b1463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.679445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54232-6a25-4915-a029-4fdbe2b1463f admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.679732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54232-6a25-4915-a029-4fdbe2b1463f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.680003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54232-6a25-4915-a029-4fdbe2b1463f admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.680652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f54232-6a25-4915-a029-4fdbe2b1463f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.681695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-a9f54232-6a25-4915-a029-4fdbe2b1463f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:53:02.681695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:53:02.681695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:53:02.682903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f54232-6a25-4915-a029-4fdbe2b1463f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.718000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 777/1560] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:02.718000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.718000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60831267-a9c7-454c-afcc-1e33720dc880 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.721871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.722489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.722780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.723058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.723771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.725509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.738828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 778/1561] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:02.740129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.748445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.755960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9339-dbb2-48b4-bd9c-af66f5ab1128 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.761615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.762238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.762512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.762788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.763515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.763847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.764892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING py.warnings [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:53:02.764892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: warnings.warn(msg) Aug 18 20:53:02.764892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: Aug 18 20:53:02.765851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c205d9a-8d01-4e3d-85d2-54f42b5ca672 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.779411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 779/1562] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.780817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f249c-6c4b-4565-a187-ae40257fddf8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.782741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f249c-6c4b-4565-a187-ae40257fddf8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.782741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f249c-6c4b-4565-a187-ae40257fddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.801236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0a4f249c-6c4b-4565-a187-ae40257fddf8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.802455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0a4f249c-6c4b-4565-a187-ae40257fddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.811424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 780/1563] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.830537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d37ff5-2cf6-4bc1-bc75-68e38d1766ef None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.830537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d37ff5-2cf6-4bc1-bc75-68e38d1766ef None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.830537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d37ff5-2cf6-4bc1-bc75-68e38d1766ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.831114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 784/1564] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:02.831114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4064-ab42-4658-9565-83798b5ecd43 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.831114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4064-ab42-4658-9565-83798b5ecd43 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.831114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4064-ab42-4658-9565-83798b5ecd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.839236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-17d37ff5-2cf6-4bc1-bc75-68e38d1766ef None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.840709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-17d37ff5-2cf6-4bc1-bc75-68e38d1766ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.852278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2a6d4064-ab42-4658-9565-83798b5ecd43 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.853597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2a6d4064-ab42-4658-9565-83798b5ecd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.917592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 781/1565] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.918560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d37ff5-2cf6-4bc1-bc75-68e38d1766ef None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.931435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d37ff5-2cf6-4bc1-bc75-68e38d1766ef None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.935097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 785/1566] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:02.938833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d4064-ab42-4658-9565-83798b5ecd43 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.946688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.947059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d4064-ab42-4658-9565-83798b5ecd43 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.947966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.948465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.948994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.950139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.952737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.960710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.960710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.960965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.961070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.961070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.961070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.968339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 786/1567] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:02.969120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.981615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1437e-4283-4b28-9ded-96956b3bc7c6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.986582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.987295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.987599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.987878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] PATH_INFO: `/v3/projects/0c2164af6cb24bcd89bb8b6df6b9184a/users/233c01b20bac43c484778f43a84dd2c5/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.004725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2164af6cb24bcd89bb8b6df6b9184a, user_id=233c01b20bac43c484778f43a84dd2c5, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.005751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:53:03.005751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:53:03.005751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:53:03.007833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.059787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 782/1568] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/projects => generated 355 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:03.060630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.093013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 787/1569] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:02 2022] PUT /identity/v3/projects/0c2164af6cb24bcd89bb8b6df6b9184a/users/233c01b20bac43c484778f43a84dd2c5/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:03.104135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.136444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d356c-89ca-48c1-ac25-9de6774f572a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.201020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858426-a70d-4329-9ca7-da6dd39d0c77 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.209321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.210412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.210906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.211435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.212598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.216397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.233517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e81639-1867-4231-8077-86bac7596e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.234247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81639-1867-4231-8077-86bac7596e36 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.234536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81639-1867-4231-8077-86bac7596e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.235229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81639-1867-4231-8077-86bac7596e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.235963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e81639-1867-4231-8077-86bac7596e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.238154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e81639-1867-4231-8077-86bac7596e36 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.256578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.316423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 788/1570] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:03.317633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.329126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6359d-8347-4f4e-b47e-1a6ceecae40d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.333955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.334629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.334964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.335281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.336060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.336457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.338186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.359841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 789/1571] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.359841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.371071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 783/1572] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/projects => generated 371 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:03.371187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8ce1-4d80-4c2e-8fcf-df62c2a3e20e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.371727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8ce1-4d80-4c2e-8fcf-df62c2a3e20e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.372213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8ce1-4d80-4c2e-8fcf-df62c2a3e20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.373421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.377763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac737f-eeaf-4790-9eb5-86cee5c0ee08 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.401458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-56ed8ce1-4d80-4c2e-8fcf-df62c2a3e20e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:03.403265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-56ed8ce1-4d80-4c2e-8fcf-df62c2a3e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:03.466922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.468015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.468490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.468955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.469967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.470481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.473680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.477744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 784/1573] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:03.477744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8ce1-4d80-4c2e-8fcf-df62c2a3e20e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.488922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8ce1-4d80-4c2e-8fcf-df62c2a3e20e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.492493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e9ba4-2713-4ef3-8950-bd7d3742467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.493122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e9ba4-2713-4ef3-8950-bd7d3742467a admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.493404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e9ba4-2713-4ef3-8950-bd7d3742467a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.493677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e9ba4-2713-4ef3-8950-bd7d3742467a admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.494339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e9ba4-2713-4ef3-8950-bd7d3742467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.496043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e9ba4-2713-4ef3-8950-bd7d3742467a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.496468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 790/1574] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.498066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.513516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d389c-e795-4a89-bf17-f09931f76e7b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.515027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 785/1575] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:03.516568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4832e-bdd5-4583-b7ff-3d055422e601 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.516864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4832e-bdd5-4583-b7ff-3d055422e601 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.517136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4832e-bdd5-4583-b7ff-3d055422e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.525203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.526033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.526419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.526900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.527900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.530487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.549454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-b2d4832e-bdd5-4583-b7ff-3d055422e601 None None] MFA Rules not processed for user `233c01b20bac43c484778f43a84dd2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:03.550699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b2d4832e-bdd5-4583-b7ff-3d055422e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:03.624690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 786/1576] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:03.625554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4832e-bdd5-4583-b7ff-3d055422e601 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.638573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4832e-bdd5-4583-b7ff-3d055422e601 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.644759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.645444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.645791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.646091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.647348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.649158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.661156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 787/1577] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:03.663425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.675831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52586643-2aa4-4702-a6f0-f580285995fa admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.681120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.681750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.682033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.682312 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.682958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.685004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.708729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 791/1578] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/users => generated 278 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:03.710811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.729185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8ec5-f211-409e-9d66-67716ffe3783 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.737538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.738534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.739072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.739535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.740640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.744424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.802429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 788/1579] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:03.803400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.857494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.880165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d47d53-d6e7-49fb-848e-8a7eaddf9b2a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.885447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.886094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.886375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.886650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.887337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.887680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.893940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 792/1580] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:03.894235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.894450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.904579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0b424-21c5-4fa2-86a2-814189658920 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.908207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 789/1581] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.908207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.912326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.913942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.914447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.914922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.915915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.918578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.919001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9dcb5-f1fe-4ef2-95eb-1e1f0d46590b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.924573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.925270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.925554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.925833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] PATH_INFO: `/v3/projects/df334d744de34d76814c568aab5fb8b5/users/cc91169fe4d142948323130019f5e8e9/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.943149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df334d744de34d76814c568aab5fb8b5, user_id=cc91169fe4d142948323130019f5e8e9, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.946660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.082493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 793/1582] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:04.082493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.093166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 790/1583] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:03 2022] PUT /identity/v3/projects/df334d744de34d76814c568aab5fb8b5/users/cc91169fe4d142948323130019f5e8e9/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:04.093166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.160097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c762c-e5c1-45a1-af97-96b06674fdaa admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.186617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f57ef4-7bc7-4c5d-9a53-42c638eed1a9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.192253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.193471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.194492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.194912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.196202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.198284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.211771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 791/1584] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:04.213271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.220521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.232245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce1f5a-a5f6-4964-a7eb-c6f3eff70277 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.238015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.238721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.239109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.239541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.240200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.240399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.241382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.241874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.242354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.242530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.243170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.245747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.255914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 792/1585] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:04.257595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.270175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff3b6-dc11-4fed-9ff0-bf095fc27e07 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.276313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.276931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.277213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.277489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.278164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.280148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.376535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 794/1586] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/projects => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:04.376535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.390298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 793/1587] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:04.391466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.406841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256af4-0fff-4e8b-9557-5855e5aabc3f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.469764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766516-1f8a-44a9-acd6-9bd954295bf4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.476062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.476954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.477367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.477844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.478691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.480700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.484682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f9778-68aa-4fd7-9c2a-2aa28960790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.485434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9778-68aa-4fd7-9c2a-2aa28960790a admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.485851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9778-68aa-4fd7-9c2a-2aa28960790a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.486238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9778-68aa-4fd7-9c2a-2aa28960790a admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.487254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f9778-68aa-4fd7-9c2a-2aa28960790a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.490225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f9778-68aa-4fd7-9c2a-2aa28960790a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.497127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 795/1588] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:04.497127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.512485 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6334-fa31-4c02-afb0-71f946901cf1 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.518766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.519664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.520047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.525082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.525082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.525082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.622006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 794/1589] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/projects => generated 393 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:04.623666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594391-9db2-42e1-a8bd-ad14d9509a92 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.624154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594391-9db2-42e1-a8bd-ad14d9509a92 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.624621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594391-9db2-42e1-a8bd-ad14d9509a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.633018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.652870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 796/1590] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:04.654806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.664554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-da594391-9db2-42e1-a8bd-ad14d9509a92 None None] MFA Rules not processed for user `cc91169fe4d142948323130019f5e8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:04.665966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-da594391-9db2-42e1-a8bd-ad14d9509a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:04.673420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f605e5-7ecd-4a5d-b8bf-7a1e57c76a51 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.754841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.755619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.755875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.756142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] PATH_INFO: `/v3/projects/f3753c15cb9145798d47c59f5e3e3eb2/users/2aac3f891cb94ab9983c9615dd046c1b/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.758544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 795/1591] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:04.760473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da594391-9db2-42e1-a8bd-ad14d9509a92 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.775167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3753c15cb9145798d47c59f5e3e3eb2, user_id=2aac3f891cb94ab9983c9615dd046c1b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.778122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.780594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da594391-9db2-42e1-a8bd-ad14d9509a92 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.789134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.790018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.790599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.790976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.792059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.794686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.812048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 796/1592] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:04.812048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.826310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c94e-ed19-4765-b419-bf37d2029b0e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.832054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.832951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.833373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.833737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.834578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.836912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.876043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 797/1593] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:04 2022] PUT /identity/v3/projects/f3753c15cb9145798d47c59f5e3e3eb2/users/2aac3f891cb94ab9983c9615dd046c1b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:04.877161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.921053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.954992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da147-c983-471a-8992-2377440e4649 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.963175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.964272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.964777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.965285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.966484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.966907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 797/1594] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:04.967790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.970818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.981821 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd702-1efc-4241-a247-f2fcec14ba8f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.987388 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.988106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.988458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.988847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.989403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 798/1595] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:04.989838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.991533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.993823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.007947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af458d92-aed7-4b16-ba55-1c88472f4112 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.014992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 798/1596] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:05.014992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.015693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d299d-9950-4218-81ef-121629d64171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.016684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d299d-9950-4218-81ef-121629d64171 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.017174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d299d-9950-4218-81ef-121629d64171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.017714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d299d-9950-4218-81ef-121629d64171 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.018963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d299d-9950-4218-81ef-121629d64171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.023166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d299d-9950-4218-81ef-121629d64171 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.029844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47196b4-a062-4ba0-957a-b4c44f4e2e58 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.037090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ab07-6953-4748-b509-1565c04875a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.038479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ab07-6953-4748-b509-1565c04875a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.038949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ab07-6953-4748-b509-1565c04875a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.039442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ab07-6953-4748-b509-1565c04875a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.040365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ab07-6953-4748-b509-1565c04875a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.042790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ab07-6953-4748-b509-1565c04875a4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.054120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 799/1597] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:05.056424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefeb2b-37ff-46a7-b798-a3fd233ceb5b None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.056933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefeb2b-37ff-46a7-b798-a3fd233ceb5b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.057422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefeb2b-37ff-46a7-b798-a3fd233ceb5b None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.059670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 800/1598] 10.222.0.62 () {54 vars in 962 bytes} [Thu Aug 18 20:53:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:05.060851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefeb2b-37ff-46a7-b798-a3fd233ceb5b None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.076387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefeb2b-37ff-46a7-b798-a3fd233ceb5b None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.081633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.082353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.082677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.083158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] PATH_INFO: `/v3/projects/35db02a695bc4bfea8c226fc79848e16/users/6d84771953d44ff387df7e700f45435f/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.101706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35db02a695bc4bfea8c226fc79848e16, user_id=6d84771953d44ff387df7e700f45435f, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.104640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.115716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 799/1599] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:05.126885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d807c0-b92c-47d6-ad9f-75df73e60852 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.126885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d807c0-b92c-47d6-ad9f-75df73e60852 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.126885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d807c0-b92c-47d6-ad9f-75df73e60852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.149853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-49d807c0-b92c-47d6-ad9f-75df73e60852 None None] MFA Rules not processed for user `2aac3f891cb94ab9983c9615dd046c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:05.151205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-49d807c0-b92c-47d6-ad9f-75df73e60852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:05.223166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 800/1600] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:05.223824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d807c0-b92c-47d6-ad9f-75df73e60852 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.236301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 801/1601] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:05 2022] PUT /identity/v3/projects/35db02a695bc4bfea8c226fc79848e16/users/6d84771953d44ff387df7e700f45435f/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:05.237699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.238946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d807c0-b92c-47d6-ad9f-75df73e60852 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.324796 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.325852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.326340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.326830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.328055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.331221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.335243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effee69-e3f3-465c-a21e-f051baef50b4 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.340898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.341534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.341812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.342091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.342784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.344535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.353244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 801/1602] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:05.354908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.364876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 802/1603] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:05.366203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.375391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08539075-2570-4c4d-a795-6ab428f8383f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.377665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cafcdc-d9fb-4b75-b92d-78ca9018f363 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.382642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf293a-8452-43b2-9a9c-2c7e08e51814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.383275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf293a-8452-43b2-9a9c-2c7e08e51814 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.383598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf293a-8452-43b2-9a9c-2c7e08e51814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.383895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf293a-8452-43b2-9a9c-2c7e08e51814 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.384076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.384561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf293a-8452-43b2-9a9c-2c7e08e51814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.385225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.385727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.386226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf293a-8452-43b2-9a9c-2c7e08e51814 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.386378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] PATH_INFO: `/v3/projects/4a8a7951b0d34c5e8e399b13c5424f2d/users/9ea7f97f6fdd4977bb85c578a2bd7c21/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.398396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 803/1604] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:05.399763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38834-eead-4646-afb9-23a49fc61865 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.400053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38834-eead-4646-afb9-23a49fc61865 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.400333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38834-eead-4646-afb9-23a49fc61865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.407659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.417011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a7951b0d34c5e8e399b13c5424f2d, user_id=9ea7f97f6fdd4977bb85c578a2bd7c21, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.422960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.448592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-92a38834-eead-4646-afb9-23a49fc61865 None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:05.450001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-92a38834-eead-4646-afb9-23a49fc61865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:05.505767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 802/1605] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:05 2022] PUT /identity/v3/projects/4a8a7951b0d34c5e8e399b13c5424f2d/users/9ea7f97f6fdd4977bb85c578a2bd7c21/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:05.507820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.529220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 804/1606] 10.222.0.62 () {58 vars in 1059 bytes} [Thu Aug 18 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:05.530203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38834-eead-4646-afb9-23a49fc61865 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.542523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38834-eead-4646-afb9-23a49fc61865 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.544399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.607416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f2720-0c1d-46fb-b3a8-7a0d145cb0e3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.614924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062e3e-1060-46da-972e-ed3280432bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.615961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062e3e-1060-46da-972e-ed3280432bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.616432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062e3e-1060-46da-972e-ed3280432bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.616893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062e3e-1060-46da-972e-ed3280432bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.617956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062e3e-1060-46da-972e-ed3280432bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.620874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062e3e-1060-46da-972e-ed3280432bb1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.635729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.636582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.636582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.636917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.637398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.639393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.645705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 803/1607] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:05.645705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f1e7f-8f81-4950-9dbf-eeb56268b044 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.645705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f1e7f-8f81-4950-9dbf-eeb56268b044 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.645705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f1e7f-8f81-4950-9dbf-eeb56268b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.684099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d42f1e7f-8f81-4950-9dbf-eeb56268b044 None None] MFA Rules not processed for user `6d84771953d44ff387df7e700f45435f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:05.685570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d42f1e7f-8f81-4950-9dbf-eeb56268b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:05.758317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 805/1608] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:05 2022] POST /identity/v3/projects => generated 403 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:05.759911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.777098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 804/1609] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:05.782460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f1e7f-8f81-4950-9dbf-eeb56268b044 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.795654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f1e7f-8f81-4950-9dbf-eeb56268b044 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.848517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a63b-5c1d-4bdf-a4c8-57bded75c37a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.854282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.854989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.855269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.855582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] PATH_INFO: `/v3/projects/e210122fcfe747dd8010fcfedaf33f69/users/8c7b1148e2694cedb079ab337fc70a70/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.870964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.875460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e210122fcfe747dd8010fcfedaf33f69, user_id=8c7b1148e2694cedb079ab337fc70a70, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.875682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9a68-10a5-46cf-a4d0-97f3e0cfd11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.876272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9a68-10a5-46cf-a4d0-97f3e0cfd11e admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.876547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9a68-10a5-46cf-a4d0-97f3e0cfd11e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.876820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9a68-10a5-46cf-a4d0-97f3e0cfd11e admin admin] PATH_INFO: `/v3/projects/abf631fcae584ce1a0b8c26560398cea/users/b5b5dd3c92034837921826c9b2dea76b/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.879123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.895787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a9a68-10a5-46cf-a4d0-97f3e0cfd11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf631fcae584ce1a0b8c26560398cea, user_id=b5b5dd3c92034837921826c9b2dea76b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.898864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a9a68-10a5-46cf-a4d0-97f3e0cfd11e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.009182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 806/1610] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:05 2022] PUT /identity/v3/projects/e210122fcfe747dd8010fcfedaf33f69/users/8c7b1148e2694cedb079ab337fc70a70/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:06.009182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.030410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 805/1611] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:05 2022] PUT /identity/v3/projects/abf631fcae584ce1a0b8c26560398cea/users/b5b5dd3c92034837921826c9b2dea76b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:06.032325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ce31-5dc0-4dac-9725-40509d9adf5b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.032832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ce31-5dc0-4dac-9725-40509d9adf5b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.033427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ce31-5dc0-4dac-9725-40509d9adf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.077803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-70e7ce31-5dc0-4dac-9725-40509d9adf5b None None] MFA Rules not processed for user `9ea7f97f6fdd4977bb85c578a2bd7c21`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:06.079036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-70e7ce31-5dc0-4dac-9725-40509d9adf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:06.096395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.108289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199450-b199-412c-a77b-fe3f1d0b3b73 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.160063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 806/1612] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:06.160809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ce31-5dc0-4dac-9725-40509d9adf5b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.219740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.220916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.221440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.221949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] PATH_INFO: `/v3/projects/7a536708296847aeb7a88156d077da60/users/41b8a21b3d0747c68eda9f991d735772/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.252217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a536708296847aeb7a88156d077da60, user_id=41b8a21b3d0747c68eda9f991d735772, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.255617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.259727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ce31-5dc0-4dac-9725-40509d9adf5b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.265762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.266390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.266669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.266961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.331335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.333006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.344424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 807/1613] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:06.345531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.362114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77d8c3-b395-41d1-b2f2-549295b5c6e5 service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.363345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 807/1614] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:06 2022] PUT /identity/v3/projects/7a536708296847aeb7a88156d077da60/users/41b8a21b3d0747c68eda9f991d735772/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:06.364999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.446110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.461087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.461653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8808f-45f3-4b6c-8892-22dcb8168126 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.461968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.462356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.462826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.463838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.465826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.467691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.468430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.468807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.469609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.469913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.472025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.479817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 808/1615] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:06.481377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.496494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0d834-ef40-4b76-af5e-ae8d9c7e7eab admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.503280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d55abc-6d73-47be-af77-da13bea2a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.504959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d55abc-6d73-47be-af77-da13bea2a5bf admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.505143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d55abc-6d73-47be-af77-da13bea2a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.505591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d55abc-6d73-47be-af77-da13bea2a5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.506954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d55abc-6d73-47be-af77-da13bea2a5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.508983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d55abc-6d73-47be-af77-da13bea2a5bf admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.568275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 808/1616] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/users => generated 308 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:06.570556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.582949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06045a-7e02-4d48-a073-896c32880307 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.588304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d181573-a89b-41fa-910b-7a6e537c6ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.588947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181573-a89b-41fa-910b-7a6e537c6ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.589261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181573-a89b-41fa-910b-7a6e537c6ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.589534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181573-a89b-41fa-910b-7a6e537c6ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.590213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d181573-a89b-41fa-910b-7a6e537c6ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.592016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d181573-a89b-41fa-910b-7a6e537c6ce8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.595167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.613629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 809/1617] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:06.613629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef565-cfce-4002-8313-438cf7a9a4a7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.613629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef565-cfce-4002-8313-438cf7a9a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.614051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef565-cfce-4002-8313-438cf7a9a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.620932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 809/1618] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:06.620932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d51b31-65dd-420a-9c51-209e844249b6 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.620932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d51b31-65dd-420a-9c51-209e844249b6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.620932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d51b31-65dd-420a-9c51-209e844249b6 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.621727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 810/1619] 10.222.0.62 () {54 vars in 962 bytes} [Thu Aug 18 20:53:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:06.624047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5d0c5-b6b3-46de-8a50-fd5d894efd96 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.624628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5d0c5-b6b3-46de-8a50-fd5d894efd96 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.625200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5d0c5-b6b3-46de-8a50-fd5d894efd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.654712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-92a5d0c5-b6b3-46de-8a50-fd5d894efd96 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:06.656513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-92a5d0c5-b6b3-46de-8a50-fd5d894efd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:06.663438 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7ccef565-cfce-4002-8313-438cf7a9a4a7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:06.667176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7ccef565-cfce-4002-8313-438cf7a9a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:06.738889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 810/1620] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:06.739622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef565-cfce-4002-8313-438cf7a9a4a7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.752477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 811/1621] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:06.754470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5d0c5-b6b3-46de-8a50-fd5d894efd96 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.761130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef565-cfce-4002-8313-438cf7a9a4a7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.769975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd45cf1-4eb9-4ad7-b118-a772e5f4c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.775467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5d0c5-b6b3-46de-8a50-fd5d894efd96 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.775637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd45cf1-4eb9-4ad7-b118-a772e5f4c973 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.775637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd45cf1-4eb9-4ad7-b118-a772e5f4c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.775637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd45cf1-4eb9-4ad7-b118-a772e5f4c973 admin admin] PATH_INFO: `/v3/projects/119af0f155d0477cbc4a15a054070278/users/86c2b496a2c04a0094bf30111bf25669/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.776197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.776819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.777101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.777373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.778860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.779698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.795513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 812/1622] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:06.795513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.808401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52216-50ec-4ec7-aed3-3cde50d2ead9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.812260 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd45cf1-4eb9-4ad7-b118-a772e5f4c973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119af0f155d0477cbc4a15a054070278, user_id=86c2b496a2c04a0094bf30111bf25669, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.813920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.814676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.815017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.815324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd45cf1-4eb9-4ad7-b118-a772e5f4c973 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.815470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] PATH_INFO: `/v3/projects/e210122fcfe747dd8010fcfedaf33f69/users/8c7b1148e2694cedb079ab337fc70a70/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.817624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e210122fcfe747dd8010fcfedaf33f69, user_id=8c7b1148e2694cedb079ab337fc70a70, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.821323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.842645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 813/1623] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:06 2022] PUT /identity/v3/projects/e210122fcfe747dd8010fcfedaf33f69/users/8c7b1148e2694cedb079ab337fc70a70/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:06.842645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.910120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 811/1624] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:06 2022] PUT /identity/v3/projects/119af0f155d0477cbc4a15a054070278/users/86c2b496a2c04a0094bf30111bf25669/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:06.915956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.916253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.916531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.934122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc218e8-d3dc-4cb4-bf32-ed51fb8c182a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.937580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:06.938817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:06.987914 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.005516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.006653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.007240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.007838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.008777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.012883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.015807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 812/1625] 10.222.0.62 () {58 vars in 1059 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:07.016665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.018033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:07.080063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb717-48e4-4514-8125-23c172aebb0b None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.085503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.086147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.086424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.086691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.096873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.098334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.108803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 813/1626] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:07.109681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.118776 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f768b-3291-4067-916c-bc100a09cf7a service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.122592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9c6a0-6939-4695-8242-0cfa9d176148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.123210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c6a0-6939-4695-8242-0cfa9d176148 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.123539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c6a0-6939-4695-8242-0cfa9d176148 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.123812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9c6a0-6939-4695-8242-0cfa9d176148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.131959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.134660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9c6a0-6939-4695-8242-0cfa9d176148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.136634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9c6a0-6939-4695-8242-0cfa9d176148 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.144822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 814/1627] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/users => generated 285 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:07.147916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.148026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 814/1628] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:07.149198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3094-0315-4b27-925d-b5a8b82d1363 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.149483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3094-0315-4b27-925d-b5a8b82d1363 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.149756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3094-0315-4b27-925d-b5a8b82d1363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.157739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87958825-5543-410d-bca0-3a0a479af76b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.162849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e99f56-bdc0-4ac8-8dab-91104e2c3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.163597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e99f56-bdc0-4ac8-8dab-91104e2c3670 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.163874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e99f56-bdc0-4ac8-8dab-91104e2c3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.164453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e99f56-bdc0-4ac8-8dab-91104e2c3670 admin admin] PATH_INFO: `/v3/projects/6d422c918ca6493a82082e3d1559e4f7/users/5f4b3a2413d2498c9a243ced816359f9/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.180760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e99f56-bdc0-4ac8-8dab-91104e2c3670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d422c918ca6493a82082e3d1559e4f7, user_id=5f4b3a2413d2498c9a243ced816359f9, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.183483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-b2fe3094-0315-4b27-925d-b5a8b82d1363 None None] MFA Rules not processed for user `8c7b1148e2694cedb079ab337fc70a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:07.183865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e99f56-bdc0-4ac8-8dab-91104e2c3670 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.184706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b2fe3094-0315-4b27-925d-b5a8b82d1363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:07.251866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 815/1629] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:07.253153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527bb7a-9108-4fb8-b5dd-cde28b2651cb None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.253440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527bb7a-9108-4fb8-b5dd-cde28b2651cb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.253713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527bb7a-9108-4fb8-b5dd-cde28b2651cb None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.255072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 816/1630] 10.222.0.62 () {54 vars in 912 bytes} [Thu Aug 18 20:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:07.256897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c437-a395-4f79-b2cb-5e68e525b8e6 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.257181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c437-a395-4f79-b2cb-5e68e525b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.257435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c437-a395-4f79-b2cb-5e68e525b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.279556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c426c437-a395-4f79-b2cb-5e68e525b8e6 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:07.280845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c426c437-a395-4f79-b2cb-5e68e525b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:07.290387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 817/1631] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:07.291273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426c437-a395-4f79-b2cb-5e68e525b8e6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.306157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426c437-a395-4f79-b2cb-5e68e525b8e6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.312659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.313317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.313606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.313872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.393309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.396733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.418204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 818/1632] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:07.419512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.430302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 815/1633] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:07 2022] PUT /identity/v3/projects/6d422c918ca6493a82082e3d1559e4f7/users/5f4b3a2413d2498c9a243ced816359f9/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:07.432514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff520e9-9305-4cdd-a0b8-e83ac42901fb None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.433269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff520e9-9305-4cdd-a0b8-e83ac42901fb None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.433767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff520e9-9305-4cdd-a0b8-e83ac42901fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.438204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62b5dc-9d17-4095-adcd-214a18b515f5 service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.473628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7ff520e9-9305-4cdd-a0b8-e83ac42901fb None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:07.476812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7ff520e9-9305-4cdd-a0b8-e83ac42901fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:07.589875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.591738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.592972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.593442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.595229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.599140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.626587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 819/1634] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:07.628595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.632608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 816/1635] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:07.634179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff520e9-9305-4cdd-a0b8-e83ac42901fb None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.649915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.745701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34924b3-914b-4f70-a88f-0bc10c72adc4 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.746846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff520e9-9305-4cdd-a0b8-e83ac42901fb None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.752021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.752788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.753147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.754398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.754646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.754819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.755151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.755689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.766515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.768032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.781182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 817/1636] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:07.781463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.796025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c7be8-205c-440d-932f-a7e73196c7be service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.805749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.806664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.807126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.807717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.808647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.810572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.832530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 818/1637] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:07.832530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.846225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad53d2-31e7-4d86-a99f-f2d700024c82 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.852924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.853741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.854078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.854547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] PATH_INFO: `/v3/projects/8750f437413b427b84b586600954e4a2/users/9954a5d1b2a349feaf702222f73edd17/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.882565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8750f437413b427b84b586600954e4a2, user_id=9954a5d1b2a349feaf702222f73edd17, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.885809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.903611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.905107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.916916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 820/1638] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:07.917853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.928489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f5f0e-19f8-43b7-8485-300eeff113b6 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.932981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac27b-c74d-4c67-acfd-ee9d65fbe7bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.933641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac27b-c74d-4c67-acfd-ee9d65fbe7bf service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.933901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac27b-c74d-4c67-acfd-ee9d65fbe7bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.934167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac27b-c74d-4c67-acfd-ee9d65fbe7bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.948574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac27b-c74d-4c67-acfd-ee9d65fbe7bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.951187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac27b-c74d-4c67-acfd-ee9d65fbe7bf service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.989073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 821/1639] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:07.993672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 819/1640] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:07 2022] PUT /identity/v3/projects/8750f437413b427b84b586600954e4a2/users/9954a5d1b2a349feaf702222f73edd17/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:07.993672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.996085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed048-f29c-4f92-a57c-008c1913df3c None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.996525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed048-f29c-4f92-a57c-008c1913df3c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.996859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed048-f29c-4f92-a57c-008c1913df3c None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.998073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 822/1641] 10.222.0.62 () {54 vars in 912 bytes} [Thu Aug 18 20:53:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:08.003543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ed048-f29c-4f92-a57c-008c1913df3c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.056683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.174557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ed048-f29c-4f92-a57c-008c1913df3c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.185726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf0092-0fc1-415c-894d-85efa23bc5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.185726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf0092-0fc1-415c-894d-85efa23bc5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.192102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf0092-0fc1-415c-894d-85efa23bc5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.192479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf0092-0fc1-415c-894d-85efa23bc5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.196805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf0092-0fc1-415c-894d-85efa23bc5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.198538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf0092-0fc1-415c-894d-85efa23bc5e6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.213174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab2fb0-61a9-4aae-aab3-794f757be34c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.229275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.229968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.230249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.230719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] PATH_INFO: `/v3/projects/6d422c918ca6493a82082e3d1559e4f7/users/5f4b3a2413d2498c9a243ced816359f9/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.242678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d422c918ca6493a82082e3d1559e4f7, user_id=5f4b3a2413d2498c9a243ced816359f9, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.242678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.250397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 823/1642] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:08.252736 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9323-d092-43c3-baba-8e04e3abcbbe None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.253707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9323-d092-43c3-baba-8e04e3abcbbe None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.253707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9323-d092-43c3-baba-8e04e3abcbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.280139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 820/1643] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:07 2022] PUT /identity/v3/projects/6d422c918ca6493a82082e3d1559e4f7/users/5f4b3a2413d2498c9a243ced816359f9/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:08.281043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.326606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-96fe9323-d092-43c3-baba-8e04e3abcbbe None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:08.327899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-96fe9323-d092-43c3-baba-8e04e3abcbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:08.466839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d0ae-3b48-4887-9ac6-0f1f2a817a7e admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.471271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.479906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb216ad-f8a9-4de1-9342-37165d7c37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.480610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb216ad-f8a9-4de1-9342-37165d7c37d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.480888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb216ad-f8a9-4de1-9342-37165d7c37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.481193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb216ad-f8a9-4de1-9342-37165d7c37d6 admin admin] PATH_INFO: `/v3/projects/8750f437413b427b84b586600954e4a2/users/9954a5d1b2a349feaf702222f73edd17/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.484242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb216ad-f8a9-4de1-9342-37165d7c37d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8750f437413b427b84b586600954e4a2, user_id=9954a5d1b2a349feaf702222f73edd17, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.486996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb216ad-f8a9-4de1-9342-37165d7c37d6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.513990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 821/1644] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:08 2022] PUT /identity/v3/projects/8750f437413b427b84b586600954e4a2/users/9954a5d1b2a349feaf702222f73edd17/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:08.515309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ced2e-8a7d-41e0-b3b1-d55ed3d03007 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.515622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ced2e-8a7d-41e0-b3b1-d55ed3d03007 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.515886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ced2e-8a7d-41e0-b3b1-d55ed3d03007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.554261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a93ced2e-8a7d-41e0-b3b1-d55ed3d03007 None None] MFA Rules not processed for user `5f4b3a2413d2498c9a243ced816359f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:08.555628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a93ced2e-8a7d-41e0-b3b1-d55ed3d03007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:08.571611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 824/1645] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:08.579077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360fbe6-70c1-42e1-84b6-37b4301f1bdd None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.579352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360fbe6-70c1-42e1-84b6-37b4301f1bdd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.579655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360fbe6-70c1-42e1-84b6-37b4301f1bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.679931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d360fbe6-70c1-42e1-84b6-37b4301f1bdd None None] MFA Rules not processed for user `9954a5d1b2a349feaf702222f73edd17`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:08.684970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d360fbe6-70c1-42e1-84b6-37b4301f1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:08.715306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 822/1646] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:08.718796 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ced2e-8a7d-41e0-b3b1-d55ed3d03007 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.762587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.794347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ced2e-8a7d-41e0-b3b1-d55ed3d03007 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.799050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.801723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.801998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.802267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.821153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 825/1647] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:08.826593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360fbe6-70c1-42e1-84b6-37b4301f1bdd None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.892453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.895801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.910415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360fbe6-70c1-42e1-84b6-37b4301f1bdd None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.911350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 823/1648] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:08.912384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.940382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dcca3-dffa-49a2-9f4e-a72f19214c45 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.940382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.940382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.940382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.294904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.295670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.295670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.295670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.295670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] PATH_INFO: `/v3/users/cc91169fe4d142948323130019f5e8e9` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.296362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc91169fe4d142948323130019f5e8e9)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.296362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.296755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.296755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.296755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 824/1649] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:09.296755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.296755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941b471-b7d4-4664-949e-12ad8f7e4b7b service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.297521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcc581-8855-467e-895d-c5ccaec4580a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.297521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc581-8855-467e-895d-c5ccaec4580a service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.297521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc581-8855-467e-895d-c5ccaec4580a service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.297521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc581-8855-467e-895d-c5ccaec4580a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.298049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcc581-8855-467e-895d-c5ccaec4580a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.298049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcc581-8855-467e-895d-c5ccaec4580a service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.298049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 825/1650] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:09.381859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc91169fe4d142948323130019f5e8e9'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:09.382620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc91169fe4d142948323130019f5e8e9'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:09.391300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc91169fe4d142948323130019f5e8e9'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:09.392507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc91169fe4d142948323130019f5e8e9'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:09.398910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.409568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc91169fe4d142948323130019f5e8e9'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:09.627022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 826/1651] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:08 2022] DELETE /identity/v3/users/cc91169fe4d142948323130019f5e8e9 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:09.635312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.635814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.636287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.684180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:09.686659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:09.805664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 826/1652] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:09.821255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.822940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:09.955996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06147-03d5-4161-b248-8224f77c4886 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.961624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.962489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.962969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.963444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.975781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.977372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.999831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 827/1653] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:10.087823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.090675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:10.223098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.249666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49de1f-adab-4232-aae0-9b8fa877c6f3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.258007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e4811-19de-4317-afec-f18e3938889d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.258805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4811-19de-4317-afec-f18e3938889d service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.259535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4811-19de-4317-afec-f18e3938889d service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.259959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4811-19de-4317-afec-f18e3938889d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.266368 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f67e4811-19de-4317-afec-f18e3938889d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:10.438284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e4811-19de-4317-afec-f18e3938889d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.442363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e4811-19de-4317-afec-f18e3938889d service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.477108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 827/1654] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:10.548179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.550131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:10.572905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d5333-69af-48d8-a059-0d86dcd30852 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.607013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.607714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.607998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.608368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] PATH_INFO: `/v3/users/2aac3f891cb94ab9983c9615dd046c1b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.609880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aac3f891cb94ab9983c9615dd046c1b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.612742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.879390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aac3f891cb94ab9983c9615dd046c1b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:10.882176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aac3f891cb94ab9983c9615dd046c1b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:10.893425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aac3f891cb94ab9983c9615dd046c1b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:10.894992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aac3f891cb94ab9983c9615dd046c1b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:10.915273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aac3f891cb94ab9983c9615dd046c1b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:11.135994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 828/1655] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:10 2022] DELETE /identity/v3/users/2aac3f891cb94ab9983c9615dd046c1b => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:11.137200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.137689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.137765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.173219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:11.174967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.310344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 828/1656] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:11.356952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.359537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.575616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833785c-4582-4ca5-8222-560dbe189991 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.587279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.587964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.588509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.588790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.608089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.611043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.612608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.634622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 829/1657] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:11.688973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.690459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.707207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276f00-9dd6-4025-8003-5b1d8622be0f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.715335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.716349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.716767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.717177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] PATH_INFO: `/v3/projects/df334d744de34d76814c568aab5fb8b5` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.719213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df334d744de34d76814c568aab5fb8b5)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.729453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.759304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.766249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.788575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd6ae8-ce95-41a4-87b0-e2156a76c1bd service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.799790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.800023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.800319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.800601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] PATH_INFO: `/v3/users/233c01b20bac43c484778f43a84dd2c5` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.802161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233c01b20bac43c484778f43a84dd2c5)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.805711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.948112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df334d744de34d76814c568aab5fb8b5', 'request_id': 'req-219b1bd6-3265-4927-86e1-97ff8b96ef4a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:11.957832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df334d744de34d76814c568aab5fb8b5', 'request_id': 'req-219b1bd6-3265-4927-86e1-97ff8b96ef4a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.019301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df334d744de34d76814c568aab5fb8b5', 'request_id': 'req-219b1bd6-3265-4927-86e1-97ff8b96ef4a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.059212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233c01b20bac43c484778f43a84dd2c5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.059212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233c01b20bac43c484778f43a84dd2c5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.070097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233c01b20bac43c484778f43a84dd2c5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.070097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233c01b20bac43c484778f43a84dd2c5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.091519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] The token cache is being invalidate because project df334d744de34d76814c568aab5fb8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:12.091519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.099173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-219b1bd6-3265-4927-86e1-97ff8b96ef4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.099287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a4b1ce5b-cd68-4083-880e-17f2911453a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233c01b20bac43c484778f43a84dd2c5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:12.105825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 829/1658] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:11 2022] DELETE /identity/v3/projects/df334d744de34d76814c568aab5fb8b5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:12.109591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3d2e-18ca-46bf-81a1-990e254a51b9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.110536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3d2e-18ca-46bf-81a1-990e254a51b9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.111041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3d2e-18ca-46bf-81a1-990e254a51b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.150350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-097d3d2e-18ca-46bf-81a1-990e254a51b9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:12.150350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-097d3d2e-18ca-46bf-81a1-990e254a51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:12.178779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:12.201241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 830/1659] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:11 2022] DELETE /identity/v3/users/233c01b20bac43c484778f43a84dd2c5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:12.205602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.207850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.207850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.239019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:12.241251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:12.263556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 830/1660] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:12.277310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df31b6-cc5b-4211-9ef2-ab97fff7c0f7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.277813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df31b6-cc5b-4211-9ef2-ab97fff7c0f7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.278335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df31b6-cc5b-4211-9ef2-ab97fff7c0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.319928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f3df31b6-cc5b-4211-9ef2-ab97fff7c0f7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:12.322276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f3df31b6-cc5b-4211-9ef2-ab97fff7c0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:12.343324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 831/1661] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:12.358338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:12.360725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:12.472080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 831/1662] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:12.482002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df31b6-cc5b-4211-9ef2-ab97fff7c0f7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:12.530683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49de4f-be27-4add-88d2-5712d0a52a71 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.544119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.556030 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.556387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.556639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.579529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df31b6-cc5b-4211-9ef2-ab97fff7c0f7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.584834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:12.586380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:12.613009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.617053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.618228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.620325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.620667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 832/1663] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:12.624892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:12.626095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:12.634625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:12.694048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 832/1664] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:12.695902 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:12.722476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725950-7fd1-479f-9bbf-60f132e7be5e service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.730831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.731947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.732566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.733096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.734826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:12.738737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:13.008091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 833/1665] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:12 2022] POST /identity/v3/projects => generated 377 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:13.019266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:13.050301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc9f39-2e05-4102-89ba-80fca312c5fa admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:13.180987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:13.337774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:13.345660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.345660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.345660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.345660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:13.410966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:13.435876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:13.438449 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:13.473273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491328c8-6dab-4b6f-88f1-60e9def2dffd admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:13.531538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:13.531538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.531538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.531538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] PATH_INFO: `/v3/projects/f3753c15cb9145798d47c59f5e3e3eb2` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.532783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3753c15cb9145798d47c59f5e3e3eb2)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:13.532783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: WARNING py.warnings [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:53:13.532783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: warnings.warn(msg) Aug 18 20:53:13.532783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: Aug 18 20:53:13.532783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:13.563226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 833/1666] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:13 2022] POST /identity/v3/users => generated 289 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:13.568981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:13.680768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6a13-0c85-4a94-a3cf-e088bb50f357 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:13.711746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:13.712787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.712959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.713192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.713894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:13.715616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:13.767902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 834/1667] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:13.772733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:13.784187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800894f0-63e0-4554-b2f7-66a28389754d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:13.824430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3753c15cb9145798d47c59f5e3e3eb2', 'request_id': 'req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:13.874616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3753c15cb9145798d47c59f5e3e3eb2', 'request_id': 'req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:14.003477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.004953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.006121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.006844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.008253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:14.011799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:14.033422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 835/1668] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:14.047272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.068037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873ee2-ffd9-4b35-8449-f997057ec714 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.080783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.081994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.082432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.082876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] PATH_INFO: `/v3/projects/3c197f0a049144e0af77ca87adfe32df/users/f13ebfb50fe249a9a01838a739e223a5/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.109623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c197f0a049144e0af77ca87adfe32df, user_id=f13ebfb50fe249a9a01838a739e223a5, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:14.114365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:14.592390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3753c15cb9145798d47c59f5e3e3eb2', 'request_id': 'req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:14.631988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 836/1669] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:14 2022] PUT /identity/v3/projects/3c197f0a049144e0af77ca87adfe32df/users/f13ebfb50fe249a9a01838a739e223a5/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:14.638363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.661191 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:14.729734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] The token cache is being invalidate because project f3753c15cb9145798d47c59f5e3e3eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:14.730797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:14.743352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:14.745296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 834/1670] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:13 2022] DELETE /identity/v3/projects/f3753c15cb9145798d47c59f5e3e3eb2 => generated 0 bytes in 1310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:14.748420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.757033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:14.811577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac861-a4b1-46c8-96ac-9728ecc8dd1a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.895213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.977005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3675389-10a2-4753-b8ff-fd9ad2bc4556 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.006602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.006602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.006602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.006602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] PATH_INFO: `/v3/users/9ea7f97f6fdd4977bb85c578a2bd7c21` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.015870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea7f97f6fdd4977bb85c578a2bd7c21)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.017845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: WARNING py.warnings [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:53:15.017845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: warnings.warn(msg) Aug 18 20:53:15.017845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: Aug 18 20:53:15.020584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.038656 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.039768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.040252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.040728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] PATH_INFO: `/v3/projects/0c2164af6cb24bcd89bb8b6df6b9184a` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.047167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2164af6cb24bcd89bb8b6df6b9184a)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.051676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.504646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2164af6cb24bcd89bb8b6df6b9184a', 'request_id': 'req-a710007e-2e82-4373-b60f-9a1a87b5143e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.508622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea7f97f6fdd4977bb85c578a2bd7c21'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.527940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2164af6cb24bcd89bb8b6df6b9184a', 'request_id': 'req-a710007e-2e82-4373-b60f-9a1a87b5143e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.572739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea7f97f6fdd4977bb85c578a2bd7c21'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.575782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea7f97f6fdd4977bb85c578a2bd7c21'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.666685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea7f97f6fdd4977bb85c578a2bd7c21'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.687921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2164af6cb24bcd89bb8b6df6b9184a', 'request_id': 'req-a710007e-2e82-4373-b60f-9a1a87b5143e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.735742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] The token cache is being invalidate because project 0c2164af6cb24bcd89bb8b6df6b9184a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:15.736195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.739295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a710007e-2e82-4373-b60f-9a1a87b5143e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.742207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 835/1671] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:14 2022] DELETE /identity/v3/projects/0c2164af6cb24bcd89bb8b6df6b9184a => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:15.749653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.750255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.756903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.777423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.836123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] MFA Rules not processed for user `f13ebfb50fe249a9a01838a739e223a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:15.836341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea7f97f6fdd4977bb85c578a2bd7c21'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:15.839554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:15.856478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 837/1672] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:14 2022] DELETE /identity/v3/users/9ea7f97f6fdd4977bb85c578a2bd7c21 => generated 0 bytes in 1221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:15.860679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.865888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:16.023181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.121616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 836/1673] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:16.121616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.124846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:16.232535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494be30f-78cc-4ea7-a9a2-5d96e1d6e37a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.259046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.259242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.259558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.263735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] PATH_INFO: `/v3/users/5f4b3a2413d2498c9a243ced816359f9` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.269155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4b3a2413d2498c9a243ced816359f9)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.285611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.369284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac03b-30cb-447f-9af1-540016bb75df None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.375274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.376285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.376576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.376856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] PATH_INFO: `/v3/users/8c7b1148e2694cedb079ab337fc70a70` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.378316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7b1148e2694cedb079ab337fc70a70)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.380531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.621266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7b1148e2694cedb079ab337fc70a70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.622129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7b1148e2694cedb079ab337fc70a70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.630362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4b3a2413d2498c9a243ced816359f9'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.635181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7b1148e2694cedb079ab337fc70a70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.636800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7b1148e2694cedb079ab337fc70a70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.657969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4b3a2413d2498c9a243ced816359f9'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.660453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4b3a2413d2498c9a243ced816359f9'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.667688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f021dbb6-818b-45ce-b49a-2f5fb6480d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7b1148e2694cedb079ab337fc70a70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.704881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4b3a2413d2498c9a243ced816359f9'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.787600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 837/1674] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:16 2022] DELETE /identity/v3/users/8c7b1148e2694cedb079ab337fc70a70 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:16.789675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.790151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.790598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.841541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:16.844060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:16.847487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4b3a2413d2498c9a243ced816359f9'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:16.882674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 838/1675] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:15 2022] DELETE /identity/v3/users/5f4b3a2413d2498c9a243ced816359f9 => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:16.885032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.887586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:17.035025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 838/1676] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:17.048573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.050313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:17.123987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171832ef-5fe2-44a7-b86e-c04b17fd583f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.136256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.137655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.138233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.138783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.140512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.145945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.153123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3e74a-25fd-4d04-b09f-961dd79aa9d6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.295235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 839/1677] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:16 2022] POST /identity/v3/projects => generated 379 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:17.297460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.392476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.393737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.396735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.399646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.424808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.426321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.449649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 839/1678] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:17.580597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7a96b-6fe1-4cb1-acc5-3e54d653c992 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.597085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.600282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.606275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.606275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.606275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.613347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.742947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 840/1679] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:17 2022] POST /identity/v3/users => generated 296 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:17.749112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.758737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.764949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:17.782784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682ba67-3a6d-4dee-bb5d-0132906fc95c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.788130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26412590-844a-4188-8e3e-d6741d3906f1 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.793268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.794109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.794400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.794678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] PATH_INFO: `/v3/projects/e210122fcfe747dd8010fcfedaf33f69` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.796816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e210122fcfe747dd8010fcfedaf33f69)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.799114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.818574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.819592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.820082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.820448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.825852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.836059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.886455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 840/1680] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:17.893801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.930604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a52d5-342a-4f09-9182-bec07a3936eb admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.943681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.957522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.959235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.959747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.960198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] PATH_INFO: `/v3/projects/144f440e53fa448ba6addd19fccf5da7/users/e1664577ab50498e857bb7d81dad2c4c/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.056063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144f440e53fa448ba6addd19fccf5da7, user_id=e1664577ab50498e857bb7d81dad2c4c, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.068827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.080365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e210122fcfe747dd8010fcfedaf33f69', 'request_id': 'req-3ba13156-b203-4e84-8e35-43f40c8ddef7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.101755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e210122fcfe747dd8010fcfedaf33f69', 'request_id': 'req-3ba13156-b203-4e84-8e35-43f40c8ddef7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.181142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.206654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e210122fcfe747dd8010fcfedaf33f69', 'request_id': 'req-3ba13156-b203-4e84-8e35-43f40c8ddef7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.217735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 841/1681] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:17 2022] PUT /identity/v3/projects/144f440e53fa448ba6addd19fccf5da7/users/e1664577ab50498e857bb7d81dad2c4c/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:18.225555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.261599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] The token cache is being invalidate because project e210122fcfe747dd8010fcfedaf33f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:18.265375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.287352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.303942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 841/1682] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:17 2022] DELETE /identity/v3/projects/e210122fcfe747dd8010fcfedaf33f69 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:18.309591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.319031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:18.398939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ae2d-99aa-424b-ac52-d2cf49a3b8e2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.431090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c71e17-7b96-4d60-bcde-2bebec783c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.438544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c71e17-7b96-4d60-bcde-2bebec783c98 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.439811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c71e17-7b96-4d60-bcde-2bebec783c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.446435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c71e17-7b96-4d60-bcde-2bebec783c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.447803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c71e17-7b96-4d60-bcde-2bebec783c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.452832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c71e17-7b96-4d60-bcde-2bebec783c98 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.491929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba13156-b203-4e84-8e35-43f40c8ddef7 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.500741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.502039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.502527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.503000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] PATH_INFO: `/v3/projects/4a8a7951b0d34c5e8e399b13c5424f2d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.504540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8a7951b0d34c5e8e399b13c5424f2d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.508555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.520582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 842/1683] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:18.524385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.524385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.524385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.578786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:18.581859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:18.614401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 843/1684] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:18.630184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.634823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:18.665010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349acd74-db52-4b5b-8dea-026a740b98a9 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.688088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8a7951b0d34c5e8e399b13c5424f2d', 'request_id': 'req-6ba69a83-b03a-49b4-a34b-d8c03a886af8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.702725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8a7951b0d34c5e8e399b13c5424f2d', 'request_id': 'req-6ba69a83-b03a-49b4-a34b-d8c03a886af8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.839729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8a7951b0d34c5e8e399b13c5424f2d', 'request_id': 'req-6ba69a83-b03a-49b4-a34b-d8c03a886af8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.860649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] The token cache is being invalidate because project 4a8a7951b0d34c5e8e399b13c5424f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:18.865103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.868561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ba69a83-b03a-49b4-a34b-d8c03a886af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:18.871757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 842/1685] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:18 2022] DELETE /identity/v3/projects/4a8a7951b0d34c5e8e399b13c5424f2d => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:18.873629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cabde-1a8f-4170-8a59-af8e959eca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.873629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cabde-1a8f-4170-8a59-af8e959eca64 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.876288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cabde-1a8f-4170-8a59-af8e959eca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.876288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cabde-1a8f-4170-8a59-af8e959eca64 admin admin] PATH_INFO: `/v3/projects/144f440e53fa448ba6addd19fccf5da7/users/e1664577ab50498e857bb7d81dad2c4c/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.878037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96c22-33cc-4f83-b238-d64ae1603ed0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.878037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96c22-33cc-4f83-b238-d64ae1603ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.878689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96c22-33cc-4f83-b238-d64ae1603ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.882393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cabde-1a8f-4170-8a59-af8e959eca64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144f440e53fa448ba6addd19fccf5da7, user_id=e1664577ab50498e857bb7d81dad2c4c, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.885932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cabde-1a8f-4170-8a59-af8e959eca64 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.912862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 844/1686] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:18 2022] PUT /identity/v3/projects/144f440e53fa448ba6addd19fccf5da7/users/e1664577ab50498e857bb7d81dad2c4c/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:18.916069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.917745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.918400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.925931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d8c96c22-33cc-4f83-b238-d64ae1603ed0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:18.929924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d8c96c22-33cc-4f83-b238-d64ae1603ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:18.964979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:18.970784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.093197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 843/1687] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:19.093197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b182b-d40e-426c-afe7-5962fe108d8c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.093903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b182b-d40e-426c-afe7-5962fe108d8c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.094722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b182b-d40e-426c-afe7-5962fe108d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.143828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 845/1688] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:19.143828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.146412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.167901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24151b1c-3458-4b3f-a8fd-0f58e1470f05 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.169192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4f0b182b-d40e-426c-afe7-5962fe108d8c None None] MFA Rules not processed for user `e1664577ab50498e857bb7d81dad2c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:19.170580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4f0b182b-d40e-426c-afe7-5962fe108d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.173773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.174588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.174868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.175139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] PATH_INFO: `/v3/projects/6d422c918ca6493a82082e3d1559e4f7` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.176681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d422c918ca6493a82082e3d1559e4f7)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.179578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.342519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 844/1689] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:19.343881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b182b-d40e-426c-afe7-5962fe108d8c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.371406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b182b-d40e-426c-afe7-5962fe108d8c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.391313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d422c918ca6493a82082e3d1559e4f7', 'request_id': 'req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:19.403068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d422c918ca6493a82082e3d1559e4f7', 'request_id': 'req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:19.509258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d422c918ca6493a82082e3d1559e4f7', 'request_id': 'req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:19.529348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] The token cache is being invalidate because project 6d422c918ca6493a82082e3d1559e4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:19.529630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:19.532022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ce16fc05-2fe2-4ff5-a6e9-ec81f3d47d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:19.540940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 846/1690] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:19 2022] DELETE /identity/v3/projects/6d422c918ca6493a82082e3d1559e4f7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:19.544321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.544666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.544959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.567876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fa121-b25e-421e-a3e2-33d6cf9ffeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.567876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fa121-b25e-421e-a3e2-33d6cf9ffeba admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.567876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fa121-b25e-421e-a3e2-33d6cf9ffeba admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.567876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fa121-b25e-421e-a3e2-33d6cf9ffeba admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.571132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fa121-b25e-421e-a3e2-33d6cf9ffeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:19.571825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fa121-b25e-421e-a3e2-33d6cf9ffeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.605433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fa121-b25e-421e-a3e2-33d6cf9ffeba admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.610746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:19.617655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.653966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 847/1691] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:19.657148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 845/1692] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.658842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.662997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.665167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72d70-adb3-44d5-82c9-2b84da2a7144 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.665311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72d70-adb3-44d5-82c9-2b84da2a7144 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.665515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72d70-adb3-44d5-82c9-2b84da2a7144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.714863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a9e72d70-adb3-44d5-82c9-2b84da2a7144 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:19.719261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a9e72d70-adb3-44d5-82c9-2b84da2a7144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.742389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 846/1693] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:19.744272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e72d70-adb3-44d5-82c9-2b84da2a7144 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.766757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e72d70-adb3-44d5-82c9-2b84da2a7144 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.783105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.784233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.788423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.789469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.791140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:19.792177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.796321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.831879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 847/1694] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.833213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.838251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.888480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b475e3-c2a5-45d4-9304-105f604f52b9 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.907889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f0a8f-71d7-4360-9b76-d3b4b3777848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.908917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0a8f-71d7-4360-9b76-d3b4b3777848 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.909375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0a8f-71d7-4360-9b76-d3b4b3777848 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.921039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0a8f-71d7-4360-9b76-d3b4b3777848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.926445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21f3df-13dc-4004-88e8-1a95a3d969d4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.936640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.937985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.938341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1d6f0a8f-71d7-4360-9b76-d3b4b3777848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.938598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.939565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.940382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.945707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.959063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.097527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f0a8f-71d7-4360-9b76-d3b4b3777848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.099234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f0a8f-71d7-4360-9b76-d3b4b3777848 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.116521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 848/1695] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:20.118563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75140f-ee9f-400c-b82b-90f3ff6489df None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.119000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75140f-ee9f-400c-b82b-90f3ff6489df None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.119454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75140f-ee9f-400c-b82b-90f3ff6489df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.147877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 848/1696] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:19 2022] POST /identity/v3/projects => generated 363 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:20.150296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.168797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-de75140f-ee9f-400c-b82b-90f3ff6489df None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:20.172539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-de75140f-ee9f-400c-b82b-90f3ff6489df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:20.261638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36312386-a852-484b-8944-11967def3cd9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.268888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.270092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.270092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.270528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.271894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.274260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.303045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 849/1697] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:20.305216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75140f-ee9f-400c-b82b-90f3ff6489df None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.327177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75140f-ee9f-400c-b82b-90f3ff6489df None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.336425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.337823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.338609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.339288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.340685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.345374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.435312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 849/1698] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:20 2022] POST /identity/v3/projects => generated 363 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:20.442318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.479146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 850/1699] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:20 2022] POST /identity/v3/users => generated 282 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:20.486067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.503015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.526335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224c26-576a-457a-8ae4-50effa037b51 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.588363 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f85c2-4f3e-408b-a411-dfe4bc0b465b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.620202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.621518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.621518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.621703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.624203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:20.624203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.626868 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.675811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 850/1700] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:20.678025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.719923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff735ed-b04b-4772-a809-648b22c5b3aa admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.736672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.738036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.738568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.739077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.740516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.748223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.789696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.790743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.791173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.791670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.792999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.796404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.806397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 851/1701] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:20.810241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.810605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:20.979793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 851/1702] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:20 2022] POST /identity/v3/users => generated 282 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:20.984894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.002854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44273829-068c-4fa2-9d7a-646c91b1a2df admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.020121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.020814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.021130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.021409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.023458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6002a0-a88e-4874-b090-799d8bef473f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.029387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:21.048703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.052863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.052863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.052863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.052863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.053463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.214670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.222682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.226337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.253423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 852/1703] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:20 2022] POST /identity/v3/projects => generated 405 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:21.257561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.269692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 852/1704] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:21.270594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.312822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e950b-9b35-4879-9c46-1df3eca7bde9 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.444008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7d78-133e-44ee-900e-3d33f44e1a72 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.457297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.457935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.458344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.458730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.459439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.466006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.490753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 853/1705] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:21.494409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.502060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.502834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.505994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.505994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.507005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.513216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.519625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f2aa0-6459-471e-b81e-34ea180e0f11 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.535663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.536502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.537251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.537990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.539020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.539671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 853/1706] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:21.542089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.545726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.571552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f8bdd-abd1-48dc-9d8c-b973e1d69df7 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.583320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.584384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.584770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.585122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] PATH_INFO: `/v3/projects/a7b7b266a38843b0aaa7693b0bed2f1d/users/841885dee5e14b53a537c0dc2a3b12b6/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.627005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b7b266a38843b0aaa7693b0bed2f1d, user_id=841885dee5e14b53a537c0dc2a3b12b6, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.636188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.655972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 854/1707] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:21 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:21.655972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.685489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07821fa0-9f40-40df-a4c2-3c4c0dd3947b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.729208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09174ae0-00e4-4599-8514-9f4ecc4700a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.731152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174ae0-00e4-4599-8514-9f4ecc4700a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.732503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174ae0-00e4-4599-8514-9f4ecc4700a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.733255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174ae0-00e4-4599-8514-9f4ecc4700a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.734199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09174ae0-00e4-4599-8514-9f4ecc4700a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.737035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09174ae0-00e4-4599-8514-9f4ecc4700a5 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.758999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 854/1708] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:21 2022] PUT /identity/v3/projects/a7b7b266a38843b0aaa7693b0bed2f1d/users/841885dee5e14b53a537c0dc2a3b12b6/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:21.769164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.785397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 855/1709] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:21.788470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531b72-4997-4afa-a2f5-63d2a27583f8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.791075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531b72-4997-4afa-a2f5-63d2a27583f8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.791261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531b72-4997-4afa-a2f5-63d2a27583f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.934071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-53531b72-4997-4afa-a2f5-63d2a27583f8 None None] MFA Rules not processed for user `841885dee5e14b53a537c0dc2a3b12b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:21.936416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-53531b72-4997-4afa-a2f5-63d2a27583f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:22.007147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb74be-77d1-41d2-824d-6d97feca75e9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.023765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.024497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.025112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.027726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.028581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.029344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.031612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.053502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 856/1710] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:22.054620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531b72-4997-4afa-a2f5-63d2a27583f8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.072096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531b72-4997-4afa-a2f5-63d2a27583f8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.075272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 855/1711] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:22.076861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.083068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.084781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.085230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.085512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] PATH_INFO: `/v3/projects/fe98458dab3c4e729084ccfa2abd15c7/users/8fd6fa3c4a134db0ae189a5a5e73ec2e/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.106709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe98458dab3c4e729084ccfa2abd15c7, user_id=8fd6fa3c4a134db0ae189a5a5e73ec2e, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.109819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.119013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5a3f-3f17-4f76-bb90-17ff511ae912 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.143309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e50f-b2cb-4f4e-b26c-73a248a9ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.144723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e50f-b2cb-4f4e-b26c-73a248a9ba65 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.144895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e50f-b2cb-4f4e-b26c-73a248a9ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.145393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e50f-b2cb-4f4e-b26c-73a248a9ba65 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.146853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e50f-b2cb-4f4e-b26c-73a248a9ba65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.150787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e50f-b2cb-4f4e-b26c-73a248a9ba65 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.182187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 857/1712] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:22 2022] PUT /identity/v3/projects/fe98458dab3c4e729084ccfa2abd15c7/users/8fd6fa3c4a134db0ae189a5a5e73ec2e/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:22.188841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.374498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35985b2-ec8b-4897-9e5b-96dae1b8a6d9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.392190 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.395587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.397079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.397419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.398911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.402741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.408570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 856/1713] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:22 2022] POST /identity/v3/projects => generated 363 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:22.413256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddea7a-9d68-434d-a4e7-b3f1cbcacd6e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.413256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddea7a-9d68-434d-a4e7-b3f1cbcacd6e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.413256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddea7a-9d68-434d-a4e7-b3f1cbcacd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.439074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 858/1714] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:22.439834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.472105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fc270-bee1-4ea6-b7f7-dcec98ff0406 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.535538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-95ddea7a-9d68-434d-a4e7-b3f1cbcacd6e None None] MFA Rules not processed for user `8fd6fa3c4a134db0ae189a5a5e73ec2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:22.539912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-95ddea7a-9d68-434d-a4e7-b3f1cbcacd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:22.613184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.613836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.614123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.615127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.615127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.617193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.662464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.761886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 859/1715] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:22 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:22.761886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.794873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf9a46-c423-404a-a65b-653310371967 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.805649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.805649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.805649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.805649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] PATH_INFO: `/v3/projects/dc8a0308489c44fbb8445788f4efc1f6/users/72a435fa502b4c719e649ac8b96a7e6a/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.845086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8a0308489c44fbb8445788f4efc1f6, user_id=72a435fa502b4c719e649ac8b96a7e6a, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.855744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.866812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 857/1716] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:22.867823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddea7a-9d68-434d-a4e7-b3f1cbcacd6e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.888021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddea7a-9d68-434d-a4e7-b3f1cbcacd6e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.896967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.897548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.897827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.898104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.898847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.901666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.915822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 858/1717] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:22.916839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.932732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 860/1718] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:22 2022] PUT /identity/v3/projects/dc8a0308489c44fbb8445788f4efc1f6/users/72a435fa502b4c719e649ac8b96a7e6a/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:22.934693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5531a-a9bf-42f5-975d-6f6301ab2f07 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.937537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.107896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d073-63e3-4abf-b694-25d5b64fe071 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.125123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df86f9-8431-4fcd-87f4-ffdfeba52e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.125903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df86f9-8431-4fcd-87f4-ffdfeba52e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.126203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df86f9-8431-4fcd-87f4-ffdfeba52e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.126467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df86f9-8431-4fcd-87f4-ffdfeba52e3b admin admin] PATH_INFO: `/v3/projects/a6ade0da4e1c447a9c3c0deb802c059c/users/16d3fea0c94e4852b7322bd934ad5fb5/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.166905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df86f9-8431-4fcd-87f4-ffdfeba52e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ade0da4e1c447a9c3c0deb802c059c, user_id=16d3fea0c94e4852b7322bd934ad5fb5, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.173756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df86f9-8431-4fcd-87f4-ffdfeba52e3b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.209938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.210647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.210869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.211142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.214591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.219718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.270017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 861/1719] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:22 2022] PUT /identity/v3/projects/a6ade0da4e1c447a9c3c0deb802c059c/users/16d3fea0c94e4852b7322bd934ad5fb5/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:23.274676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3bb0-0e87-4bb1-ab24-b203e25b2f44 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.274944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3bb0-0e87-4bb1-ab24-b203e25b2f44 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.275233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3bb0-0e87-4bb1-ab24-b203e25b2f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.322587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1b9a3bb0-0e87-4bb1-ab24-b203e25b2f44 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:23.323878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1b9a3bb0-0e87-4bb1-ab24-b203e25b2f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:23.396027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 859/1720] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:22 2022] POST /identity/v3/projects => generated 363 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:23.402520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.406932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.527780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 862/1721] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:23.533602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a3bb0-0e87-4bb1-ab24-b203e25b2f44 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.541157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623771c1-be17-4eab-a9c2-ddf0ba9ee1ed admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.549404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.549404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.556012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.556012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.556012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.556012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.570719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 860/1722] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:23.573648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a3bb0-0e87-4bb1-ab24-b203e25b2f44 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.574933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.601714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eb8a7-8b70-4dec-a44d-1795075759a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.604282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb8a7-8b70-4dec-a44d-1795075759a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.604566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb8a7-8b70-4dec-a44d-1795075759a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.604840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb8a7-8b70-4dec-a44d-1795075759a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.605734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eb8a7-8b70-4dec-a44d-1795075759a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.623406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eb8a7-8b70-4dec-a44d-1795075759a7 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.630572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9f31c-5e50-4bc5-bc05-f6ff36afff7e admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.655297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.667832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.669514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.673843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] PATH_INFO: `/v3/projects/a6ade0da4e1c447a9c3c0deb802c059c/users/16d3fea0c94e4852b7322bd934ad5fb5/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.686964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ade0da4e1c447a9c3c0deb802c059c, user_id=16d3fea0c94e4852b7322bd934ad5fb5, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.718738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.775791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 861/1723] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:23 2022] PUT /identity/v3/projects/a6ade0da4e1c447a9c3c0deb802c059c/users/16d3fea0c94e4852b7322bd934ad5fb5/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:23.775791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.797140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:23.813056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 863/1724] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:23 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:23.828227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a773f1-6656-4f4e-baaf-8f05b6b25a0f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.831120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a773f1-6656-4f4e-baaf-8f05b6b25a0f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.832048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a773f1-6656-4f4e-baaf-8f05b6b25a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.030295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e3a773f1-6656-4f4e-baaf-8f05b6b25a0f None None] MFA Rules not processed for user `16d3fea0c94e4852b7322bd934ad5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.035243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e3a773f1-6656-4f4e-baaf-8f05b6b25a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.143985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d9af0-038c-4082-91e0-526570152fe3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.175055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.176026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.176508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.176997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.335856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.412302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 864/1725] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:24.414692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a773f1-6656-4f4e-baaf-8f05b6b25a0f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.513686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.516673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.565600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 862/1726] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:24.641940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a773f1-6656-4f4e-baaf-8f05b6b25a0f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.671423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.672043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.672655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.672933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.675121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.679211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.731731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 865/1727] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:24.739001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.776092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25487a3-265a-4d42-94df-4c099df0ec34 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.796281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.797548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.798161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.798719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.799860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] PATH_INFO: `/v3/projects/972e91c68b92454a922d0e308aa75b5c/users/b065ba2e80c6476fb7820ae3ad1fa454/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.899197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.924306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972e91c68b92454a922d0e308aa75b5c, user_id=b065ba2e80c6476fb7820ae3ad1fa454, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.950411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.069781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d05c7-408f-47fc-8893-ce948a5104e2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.086455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.086455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.086455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.086455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.136461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.138435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.162719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 863/1728] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:24 2022] PUT /identity/v3/projects/972e91c68b92454a922d0e308aa75b5c/users/b065ba2e80c6476fb7820ae3ad1fa454/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:25.166590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 866/1729] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:25.170486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.204018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a647537-50a8-4d7e-a0ef-d6d5e737e6ba service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.394905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09accfb1-0c9c-4cfe-b771-73350231414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.397198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09accfb1-0c9c-4cfe-b771-73350231414c admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.397841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09accfb1-0c9c-4cfe-b771-73350231414c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.398288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09accfb1-0c9c-4cfe-b771-73350231414c admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.399488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09accfb1-0c9c-4cfe-b771-73350231414c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.417154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09accfb1-0c9c-4cfe-b771-73350231414c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.444906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 867/1730] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:25.447578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.470146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10143-03ba-4cd0-9935-1e4317f7e337 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.472071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.478946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.482029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.482029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.482029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] PATH_INFO: `/v3/projects/972e91c68b92454a922d0e308aa75b5c/users/b065ba2e80c6476fb7820ae3ad1fa454/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.485416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972e91c68b92454a922d0e308aa75b5c, user_id=b065ba2e80c6476fb7820ae3ad1fa454, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.501342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.546057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 864/1731] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:25 2022] PUT /identity/v3/projects/972e91c68b92454a922d0e308aa75b5c/users/b065ba2e80c6476fb7820ae3ad1fa454/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:25.578851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6e1c-c0d8-4fdc-9a63-c5d3e8dd212f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.578851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6e1c-c0d8-4fdc-9a63-c5d3e8dd212f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.578851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6e1c-c0d8-4fdc-9a63-c5d3e8dd212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.642361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.737545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-dafd6e1c-c0d8-4fdc-9a63-c5d3e8dd212f None None] MFA Rules not processed for user `b065ba2e80c6476fb7820ae3ad1fa454`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:25.743725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dafd6e1c-c0d8-4fdc-9a63-c5d3e8dd212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:25.842628 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c40cea-2330-45e1-b3ae-60136420a927 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.865480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.865480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.865480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.865480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.977363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 868/1732] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:25.980491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213d0e-2c99-4b10-97bc-2a5860ee1d95 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.983505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213d0e-2c99-4b10-97bc-2a5860ee1d95 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.984065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213d0e-2c99-4b10-97bc-2a5860ee1d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.006230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:26.058542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-83213d0e-2c99-4b10-97bc-2a5860ee1d95 None None] MFA Rules not processed for user `86c2b496a2c04a0094bf30111bf25669`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.060868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-83213d0e-2c99-4b10-97bc-2a5860ee1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.080577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.082468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.096146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 865/1733] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:26.100576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.111125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cd60d-578b-4916-9e06-8afc40c005e7 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.118466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4196d-aeac-4225-aa21-a067907a6682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.119641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4196d-aeac-4225-aa21-a067907a6682 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.120080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4196d-aeac-4225-aa21-a067907a6682 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.120361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4196d-aeac-4225-aa21-a067907a6682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.132830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4196d-aeac-4225-aa21-a067907a6682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.134497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4196d-aeac-4225-aa21-a067907a6682 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.147699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 866/1734] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:26.175472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c296a-cc29-4ed8-b2f7-7c4b9f2001dd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.175812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c296a-cc29-4ed8-b2f7-7c4b9f2001dd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.176044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c296a-cc29-4ed8-b2f7-7c4b9f2001dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.234945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 869/1735] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:26.247096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.247409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.249081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.252974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-633c296a-cc29-4ed8-b2f7-7c4b9f2001dd None None] MFA Rules not processed for user `41b8a21b3d0747c68eda9f991d735772`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.256828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-633c296a-cc29-4ed8-b2f7-7c4b9f2001dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.297537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] MFA Rules not processed for user `86c2b496a2c04a0094bf30111bf25669`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.301838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.336663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 870/1736] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:26.355151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.356652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.432248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 867/1737] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:26.434623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.434915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.435188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.472835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] MFA Rules not processed for user `41b8a21b3d0747c68eda9f991d735772`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.474310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.490819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 868/1738] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:26.507208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.509070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.616370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca133b7-3ee5-49ab-b3d9-890208a27a1b None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.633560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162054b8-325d-4668-99cb-059c84535c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.634201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162054b8-325d-4668-99cb-059c84535c3c service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.634481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162054b8-325d-4668-99cb-059c84535c3c service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.634752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162054b8-325d-4668-99cb-059c84535c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.648490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162054b8-325d-4668-99cb-059c84535c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.651135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162054b8-325d-4668-99cb-059c84535c3c service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.661171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 871/1739] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:26.662841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43a85-ed9b-4516-b022-a1d270f31f9c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.662841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43a85-ed9b-4516-b022-a1d270f31f9c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.663325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43a85-ed9b-4516-b022-a1d270f31f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.674114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:26.705001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0be43a85-ed9b-4516-b022-a1d270f31f9c None None] MFA Rules not processed for user `b5b5dd3c92034837921826c9b2dea76b`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.706328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0be43a85-ed9b-4516-b022-a1d270f31f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.748299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b4c2e-2901-403b-95a7-1e2fc6a47636 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.781170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da9e9-7c08-47c3-b33a-c4273bb9a874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.782304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da9e9-7c08-47c3-b33a-c4273bb9a874 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.782304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da9e9-7c08-47c3-b33a-c4273bb9a874 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.782589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da9e9-7c08-47c3-b33a-c4273bb9a874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.798162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da9e9-7c08-47c3-b33a-c4273bb9a874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.818471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da9e9-7c08-47c3-b33a-c4273bb9a874 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.835511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 869/1740] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:26.875026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 872/1741] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:27.171544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.330207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c596-76e3-4029-9df3-dcd6a2856e79 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.330576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c596-76e3-4029-9df3-dcd6a2856e79 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.331506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c596-76e3-4029-9df3-dcd6a2856e79 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.337036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 870/1742] 10.222.0.62 () {54 vars in 912 bytes} [Thu Aug 18 20:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:27.357888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37ffc-cf17-42e5-8071-f14e82bfdc7f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.358857 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37ffc-cf17-42e5-8071-f14e82bfdc7f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.359744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c37ffc-cf17-42e5-8071-f14e82bfdc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.447029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-10c37ffc-cf17-42e5-8071-f14e82bfdc7f None None] MFA Rules not processed for user `162eb7d6a9894e4ca60aa8da4537a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:27.448638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-10c37ffc-cf17-42e5-8071-f14e82bfdc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.529397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 873/1743] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:27.543774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c596-76e3-4029-9df3-dcd6a2856e79 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.545731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6a94c596-76e3-4029-9df3-dcd6a2856e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.568975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c596-76e3-4029-9df3-dcd6a2856e79 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.577529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f3b5d-2bd5-4620-9e6b-c848f1666b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.579652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3b5d-2bd5-4620-9e6b-c848f1666b9e service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.579927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3b5d-2bd5-4620-9e6b-c848f1666b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.581273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3b5d-2bd5-4620-9e6b-c848f1666b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.596529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f3b5d-2bd5-4620-9e6b-c848f1666b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.598324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f3b5d-2bd5-4620-9e6b-c848f1666b9e service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.633766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 871/1744] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:27.695084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006495f-e204-43e7-a9e5-615a9755b2bd None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.695619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006495f-e204-43e7-a9e5-615a9755b2bd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.695807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006495f-e204-43e7-a9e5-615a9755b2bd None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.698406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 874/1745] 10.222.0.62 () {54 vars in 912 bytes} [Thu Aug 18 20:53:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:27.708017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcdeb7-9a0b-4134-9650-7b6e22fc9102 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.708850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcdeb7-9a0b-4134-9650-7b6e22fc9102 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.709167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcdeb7-9a0b-4134-9650-7b6e22fc9102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.800311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-84bcdeb7-9a0b-4134-9650-7b6e22fc9102 None None] MFA Rules not processed for user `162eb7d6a9894e4ca60aa8da4537a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:27.804625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-84bcdeb7-9a0b-4134-9650-7b6e22fc9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.834833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 872/1746] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:27.835772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006495f-e204-43e7-a9e5-615a9755b2bd None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.855525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006495f-e204-43e7-a9e5-615a9755b2bd None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.863708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.865183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.865469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.865751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.889414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.896486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.897999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.946461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 875/1747] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:28.174767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.563201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.784276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaaa2b-319b-4414-a484-b41fce51bf48 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.786530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaaa2b-319b-4414-a484-b41fce51bf48 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.786530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaaa2b-319b-4414-a484-b41fce51bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.881897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ceeaaa2b-319b-4414-a484-b41fce51bf48 None None] MFA Rules not processed for user `72a435fa502b4c719e649ac8b96a7e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:28.883813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ceeaaa2b-319b-4414-a484-b41fce51bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:28.934539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.987216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f431-52d3-431d-b062-e0c4ead90f83 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.025760 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f390be-73e0-4ed5-89a2-8f498f847407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.030286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f390be-73e0-4ed5-89a2-8f498f847407 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.030286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f390be-73e0-4ed5-89a2-8f498f847407 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.030286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f390be-73e0-4ed5-89a2-8f498f847407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.059768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 873/1748] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:29.063094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaaa2b-319b-4414-a484-b41fce51bf48 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.101311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f390be-73e0-4ed5-89a2-8f498f847407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.112188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f390be-73e0-4ed5-89a2-8f498f847407 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.199046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 876/1749] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:29.223100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4ee7-ed7f-464a-805c-bea2605c5757 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.224411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4ee7-ed7f-464a-805c-bea2605c5757 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.224859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4ee7-ed7f-464a-805c-bea2605c5757 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.227822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 877/1750] 10.222.0.62 () {54 vars in 961 bytes} [Thu Aug 18 20:53:29 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:29.265319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.272209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.274212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.329371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:29.330634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:29.338267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaaa2b-319b-4414-a484-b41fce51bf48 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.347164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.348688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.349845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.350339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.428246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.428246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.470956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 878/1751] 10.222.0.62 () {58 vars in 1058 bytes} [Thu Aug 18 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:29.471884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.473518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:29.488831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0433992-1996-4fa2-b16d-c2d5a94b25db None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.494971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.496198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.496637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.497061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.499339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:29.514668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.516664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.541386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 879/1752] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:29.542787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.574730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883f3a7-fdb4-4d14-bd65-a79acf375b61 service placement] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.584503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 874/1753] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:29 2022] POST /identity/v3/projects => generated 405 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:29.588182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db948e-8660-4425-8a7d-c0d163ec3989 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.588811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db948e-8660-4425-8a7d-c0d163ec3989 service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.590576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.591636 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db948e-8660-4425-8a7d-c0d163ec3989 service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.594119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db948e-8660-4425-8a7d-c0d163ec3989 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.630996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db948e-8660-4425-8a7d-c0d163ec3989 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.633008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.634284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db948e-8660-4425-8a7d-c0d163ec3989 service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.650176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.667803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 880/1754] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:29.760742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03dd4-c91e-4bc6-917d-12a666ccc625 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.772819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.773623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.774061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.775984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.777567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.780624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.912532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f8565-1c78-43d5-a4c6-3d616dc2f018 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.912532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f8565-1c78-43d5-a4c6-3d616dc2f018 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.912532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f8565-1c78-43d5-a4c6-3d616dc2f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.957160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 875/1755] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:29 2022] POST /identity/v3/users => generated 309 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:29.958971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.984668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-406f8565-1c78-43d5-a4c6-3d616dc2f018 None None] MFA Rules not processed for user `86c2b496a2c04a0094bf30111bf25669`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:29.992288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-406f8565-1c78-43d5-a4c6-3d616dc2f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:30.007172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41ad9-a39d-4449-9aed-dd7e02014b04 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.052261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.057631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.063917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.071243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.072047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:30.091807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:30.117269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 876/1756] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:30.123274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:30.166698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14379-2de7-4abd-ad35-f33fcb7fd692 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.195954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.199256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.199938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.200756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] PATH_INFO: `/v3/projects/ade368c2df6e4ccc9363b8a888910a70/users/d6bd8399db254f73b33e8c008c017e01/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.249128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 881/1757] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:30.250062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f8565-1c78-43d5-a4c6-3d616dc2f018 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:30.258546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade368c2df6e4ccc9363b8a888910a70, user_id=d6bd8399db254f73b33e8c008c017e01, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:30.261918 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:30.339067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f8565-1c78-43d5-a4c6-3d616dc2f018 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.372162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.372162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.372162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.372162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] PATH_INFO: `/v3/users/8fd6fa3c4a134db0ae189a5a5e73ec2e` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.373345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd6fa3c4a134db0ae189a5a5e73ec2e)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:30.373345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:30.389438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 877/1758] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:30 2022] PUT /identity/v3/projects/ade368c2df6e4ccc9363b8a888910a70/users/d6bd8399db254f73b33e8c008c017e01/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:30.393889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:30.516608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34cd75-7b80-43f1-98f8-5b63fc01a067 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.537922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.538583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.538867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.539144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.539854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:30.541647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:30.580020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 878/1759] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:53:30.581002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:30.587602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd6fa3c4a134db0ae189a5a5e73ec2e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:30.597252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd6fa3c4a134db0ae189a5a5e73ec2e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:30.604437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df1e1-4129-4d2e-b4d8-77530ca294a6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.620202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcdca3-8c9e-4928-ac18-5309ee029b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.620903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcdca3-8c9e-4928-ac18-5309ee029b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.621188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcdca3-8c9e-4928-ac18-5309ee029b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.621468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcdca3-8c9e-4928-ac18-5309ee029b79 admin admin] PATH_INFO: `/v3/projects/ade368c2df6e4ccc9363b8a888910a70/users/d6bd8399db254f73b33e8c008c017e01/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.625673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcdca3-8c9e-4928-ac18-5309ee029b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade368c2df6e4ccc9363b8a888910a70, user_id=d6bd8399db254f73b33e8c008c017e01, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:30.627604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd6fa3c4a134db0ae189a5a5e73ec2e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:30.628369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd6fa3c4a134db0ae189a5a5e73ec2e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:30.629154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcdca3-8c9e-4928-ac18-5309ee029b79 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:30.666965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 879/1760] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:30 2022] PUT /identity/v3/projects/ade368c2df6e4ccc9363b8a888910a70/users/d6bd8399db254f73b33e8c008c017e01/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:30.672974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd6fa3c4a134db0ae189a5a5e73ec2e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:30.847503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 882/1761] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:30 2022] DELETE /identity/v3/users/8fd6fa3c4a134db0ae189a5a5e73ec2e => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:30.852885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.853177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.853456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.876029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:30.877783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:30.993853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.013142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 880/1762] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:31.096339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.098294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:31.362860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe063b-07bd-423e-a102-d3015853db4e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.375985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.377056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.377549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.378090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.411765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.412970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.435039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 883/1763] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:33.067804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.070500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:33.115168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1a405-3fa0-46da-be60-0c108cdb6fef None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.135523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.136196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.136634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.137199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] PATH_INFO: `/v3/projects/fe98458dab3c4e729084ccfa2abd15c7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.139704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe98458dab3c4e729084ccfa2abd15c7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.141909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.410837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe98458dab3c4e729084ccfa2abd15c7', 'request_id': 'req-4e335f33-2a80-4080-8fe2-246148d37eff'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:33.460559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe98458dab3c4e729084ccfa2abd15c7', 'request_id': 'req-4e335f33-2a80-4080-8fe2-246148d37eff'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:33.543134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe98458dab3c4e729084ccfa2abd15c7', 'request_id': 'req-4e335f33-2a80-4080-8fe2-246148d37eff'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:33.568960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] The token cache is being invalidate because project fe98458dab3c4e729084ccfa2abd15c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:33.569532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:33.572811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4e335f33-2a80-4080-8fe2-246148d37eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:33.590020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 881/1764] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:33 2022] DELETE /identity/v3/projects/fe98458dab3c4e729084ccfa2abd15c7 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:33.591414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.602564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a3598-5ebe-4c60-9652-54a652e2a047 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.675692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.817171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.818387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.818835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.889062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.890023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.890476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.890962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] PATH_INFO: `/v3/users/b065ba2e80c6476fb7820ae3ad1fa454` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.893907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b065ba2e80c6476fb7820ae3ad1fa454)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.899655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.915703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] MFA Rules not processed for user `d6bd8399db254f73b33e8c008c017e01`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:33.916988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:34.103660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 882/1765] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:34.274509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b065ba2e80c6476fb7820ae3ad1fa454'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:34.275775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b065ba2e80c6476fb7820ae3ad1fa454'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:34.307106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b065ba2e80c6476fb7820ae3ad1fa454'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:34.308420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b065ba2e80c6476fb7820ae3ad1fa454'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:34.348084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b065ba2e80c6476fb7820ae3ad1fa454'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:34.460817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 884/1766] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:33 2022] DELETE /identity/v3/users/b065ba2e80c6476fb7820ae3ad1fa454 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:35.430889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.432783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:35.486043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44017c72-8ce7-4d27-92c6-9478a23cb27a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.590428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.594515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:35.623003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.623699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.624168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.624619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] PATH_INFO: `/v3/users/841885dee5e14b53a537c0dc2a3b12b6` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.626486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=841885dee5e14b53a537c0dc2a3b12b6)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.629091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.636866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.771521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093a72-4751-42a0-8ba9-aa31987cea39 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.777797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.778448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.778729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.778993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] PATH_INFO: `/v3/projects/972e91c68b92454a922d0e308aa75b5c` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.780201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=972e91c68b92454a922d0e308aa75b5c)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.782413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.966655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841885dee5e14b53a537c0dc2a3b12b6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.001781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:36.043012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841885dee5e14b53a537c0dc2a3b12b6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.045726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841885dee5e14b53a537c0dc2a3b12b6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.052516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972e91c68b92454a922d0e308aa75b5c', 'request_id': 'req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.079091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972e91c68b92454a922d0e308aa75b5c', 'request_id': 'req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.089278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841885dee5e14b53a537c0dc2a3b12b6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.197289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972e91c68b92454a922d0e308aa75b5c', 'request_id': 'req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.237609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] The token cache is being invalidate because project 972e91c68b92454a922d0e308aa75b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:36.237914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.239146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2e3428b4-4e7c-4ab3-ab4a-53c608cb3b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.249426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 885/1767] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:35 2022] DELETE /identity/v3/projects/972e91c68b92454a922d0e308aa75b5c => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:36.252861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312de39a-073a-4937-8e21-9878565de7c1 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.253215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312de39a-073a-4937-8e21-9878565de7c1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.255525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312de39a-073a-4937-8e21-9878565de7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.302974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-451e186e-2db4-45b0-8cf3-2186ebf8ff6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841885dee5e14b53a537c0dc2a3b12b6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:36.312593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 883/1768] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:35 2022] DELETE /identity/v3/users/841885dee5e14b53a537c0dc2a3b12b6 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:36.319260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37136e-82e3-43da-9e98-596df8bcd43d None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.322075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37136e-82e3-43da-9e98-596df8bcd43d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.323283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37136e-82e3-43da-9e98-596df8bcd43d None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.327003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 884/1769] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:53:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:36.335309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545b55-0bb3-45b6-8b2a-1bddf87a2968 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.343885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545b55-0bb3-45b6-8b2a-1bddf87a2968 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.344421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545b55-0bb3-45b6-8b2a-1bddf87a2968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.365583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-312de39a-073a-4937-8e21-9878565de7c1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:36.378647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-312de39a-073a-4937-8e21-9878565de7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.420141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d4545b55-0bb3-45b6-8b2a-1bddf87a2968 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:36.420141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d4545b55-0bb3-45b6-8b2a-1bddf87a2968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.539660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 886/1770] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:36.541221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.541508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.541778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.585166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 885/1771] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:36.618168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:36.620534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.647710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 887/1772] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:36.655498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4545b55-0bb3-45b6-8b2a-1bddf87a2968 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.662424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.666194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.669814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4545b55-0bb3-45b6-8b2a-1bddf87a2968 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.701588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.709797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.709797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.709797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.709797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:36.709797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.709797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.738975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 886/1773] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:36.744704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.760212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51c568-a5d0-4791-a769-fe888e703665 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.769279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.770321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.770788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.771221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.772723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.775977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.937002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9424d4e-9e48-4cf8-9240-706095cf33f8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.945606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa40c3a-02ea-421c-b30a-59c17ce1235a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.946480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40c3a-02ea-421c-b30a-59c17ce1235a service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.946925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40c3a-02ea-421c-b30a-59c17ce1235a service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.947208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40c3a-02ea-421c-b30a-59c17ce1235a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.972350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40c3a-02ea-421c-b30a-59c17ce1235a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.977211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40c3a-02ea-421c-b30a-59c17ce1235a service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.998621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 888/1774] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:36.999990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5ded-d037-4e28-8ed9-34a831a7d1e1 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.000273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5ded-d037-4e28-8ed9-34a831a7d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.000548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5ded-d037-4e28-8ed9-34a831a7d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.048932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 887/1775] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/projects => generated 375 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:37.052991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.207009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d08e5ded-d037-4e28-8ed9-34a831a7d1e1 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:37.212850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d08e5ded-d037-4e28-8ed9-34a831a7d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.294693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b09c10-f840-4892-a337-479340ce3709 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.311231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.322050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.322562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.323048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.339635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.340819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.363724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.448608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 889/1776] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:37.451637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.452724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.452991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.480580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.532362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:37.532544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.542578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 888/1777] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:37 2022] POST /identity/v3/users => generated 288 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:37.544056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.565458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804e0e-128e-4019-b4dd-20dc5bc095f5 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.573326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.575615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.576150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.576730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.577684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.580839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.611579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 889/1778] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:37.613359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.630396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed2fd-f529-4aee-8df8-30c0357e3922 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.641055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.643582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.646461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.647011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.648112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.652273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.681058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 890/1779] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:37.682912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.697681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 890/1780] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:37.706292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e70836-3e2c-4b3e-a984-d48dc99cc5e6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.729803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.731171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.731889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.732406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] PATH_INFO: `/v3/projects/9f611ef9aafe440897b57f131406157f/users/0dea5bc22e164aa485cbc1b6a4967ba0/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.761792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f611ef9aafe440897b57f131406157f, user_id=0dea5bc22e164aa485cbc1b6a4967ba0, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.764936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.813486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.815212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.846551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab43d7-6d3b-4d34-a5e7-e1a10ad91681 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.862205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b0740-f18a-4c31-8c19-148590ed082b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.867141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0740-f18a-4c31-8c19-148590ed082b service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.874399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0740-f18a-4c31-8c19-148590ed082b service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.874803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0740-f18a-4c31-8c19-148590ed082b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.893660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 891/1781] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:37 2022] PUT /identity/v3/projects/9f611ef9aafe440897b57f131406157f/users/0dea5bc22e164aa485cbc1b6a4967ba0/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:37.896226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.902291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.909824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b0740-f18a-4c31-8c19-148590ed082b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.917128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b0740-f18a-4c31-8c19-148590ed082b service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.965616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 891/1782] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:37.970552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ef360-717f-47dd-b48c-fddfb41d547c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.970552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ef360-717f-47dd-b48c-fddfb41d547c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.970552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ef360-717f-47dd-b48c-fddfb41d547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.068334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-cd8ef360-717f-47dd-b48c-fddfb41d547c None None] MFA Rules not processed for user `0dea5bc22e164aa485cbc1b6a4967ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:38.085324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cd8ef360-717f-47dd-b48c-fddfb41d547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:38.180116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11059383-2534-4b7e-8750-688af5a01a0a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.196773 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.197703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.198309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.198841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.262698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 892/1783] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:38.264107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596361-3eb0-4b27-9a74-f2b2fa534fb3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.264377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596361-3eb0-4b27-9a74-f2b2fa534fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.264660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596361-3eb0-4b27-9a74-f2b2fa534fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.313341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9b596361-3eb0-4b27-9a74-f2b2fa534fb3 None None] MFA Rules not processed for user `b5b5dd3c92034837921826c9b2dea76b`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:38.314605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9b596361-3eb0-4b27-9a74-f2b2fa534fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:38.344300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.348533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.366522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 892/1784] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:38.367912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.385722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.488751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.514994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 893/1785] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:38.619856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edfc87-fc72-45f5-875e-45e45571f166 service swift] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.640135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.642131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.642131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.642131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.642518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.644696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.818512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 893/1786] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:38 2022] POST /identity/v3/projects => generated 377 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:38.822534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b596361-3eb0-4b27-9a74-f2b2fa534fb3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.850158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b596361-3eb0-4b27-9a74-f2b2fa534fb3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.060653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.061330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.061709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.061923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.062588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.085070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.254178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 894/1787] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:38 2022] POST /identity/v3/users => generated 295 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:39.260588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.292272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04d23a-5e1a-4552-975f-48e94c09b53b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.313841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.314833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.315266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.318253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.318253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.324375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.365925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 894/1788] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:39.370121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.405268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2a725-fb36-460c-8ce6-5b8bd2467d5d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.425980 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.427334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.428065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.428502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] PATH_INFO: `/v3/projects/e6434a79419c48be935597b67ea2185f/users/1d5605840291436eb276c31b83d96ff1/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.450450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6434a79419c48be935597b67ea2185f, user_id=1d5605840291436eb276c31b83d96ff1, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.454239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.598507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 895/1789] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:39 2022] PUT /identity/v3/projects/e6434a79419c48be935597b67ea2185f/users/1d5605840291436eb276c31b83d96ff1/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:39.599783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.613933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488217-90cb-43de-91e6-e52402e2c74e admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.762064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.775520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.776810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.777271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.779475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.781819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.804892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 895/1790] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:39.832198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.844606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.846844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:39.854808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458712-b5f0-4481-9897-1675834b398b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.865630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a457c-c1da-4b21-9b62-dab9860d093d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.871834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.872950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.874470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.875004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] PATH_INFO: `/v3/users/72a435fa502b4c719e649ac8b96a7e6a` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.876792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a435fa502b4c719e649ac8b96a7e6a)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.881087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.883058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3110-91ca-46a5-b4f9-827194917483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.889514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3110-91ca-46a5-b4f9-827194917483 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.889514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3110-91ca-46a5-b4f9-827194917483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.889514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3110-91ca-46a5-b4f9-827194917483 admin admin] PATH_INFO: `/v3/projects/e6434a79419c48be935597b67ea2185f/users/1d5605840291436eb276c31b83d96ff1/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.898244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3110-91ca-46a5-b4f9-827194917483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6434a79419c48be935597b67ea2185f, user_id=1d5605840291436eb276c31b83d96ff1, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.905026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3110-91ca-46a5-b4f9-827194917483 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.957211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 896/1791] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:39 2022] PUT /identity/v3/projects/e6434a79419c48be935597b67ea2185f/users/1d5605840291436eb276c31b83d96ff1/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:39.972049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.972947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.974250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.053028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] MFA Rules not processed for user `1d5605840291436eb276c31b83d96ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:40.053028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:40.215947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 897/1792] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:53:40.227710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.231146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:40.408953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.522065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b74a2-e9d8-47c7-ac27-70f3435ca3bf None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.536497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.537664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.538170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.538679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.714925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a435fa502b4c719e649ac8b96a7e6a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:40.757557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a435fa502b4c719e649ac8b96a7e6a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:40.758445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a435fa502b4c719e649ac8b96a7e6a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:40.763989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.766865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.840321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 898/1793] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:40.841907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a435fa502b4c719e649ac8b96a7e6a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:40.847253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.851454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:40.856159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.960009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf1c9b9d-837d-49ef-a4ac-c735d7200acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a435fa502b4c719e649ac8b96a7e6a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:40.981459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 896/1794] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:39 2022] DELETE /identity/v3/users/72a435fa502b4c719e649ac8b96a7e6a => generated 0 bytes in 1137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:40.984506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.984827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.988383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.085110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] MFA Rules not processed for user `162eb7d6a9894e4ca60aa8da4537a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:41.086883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.311710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 897/1795] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:41.327129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c9be-6f5f-4a23-9c81-c0e42a39f959 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.368097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.369961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.417550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118e3c-474b-4cf5-874c-c34879c3d9b0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.441843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.443226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.443678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.444065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.481203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.492275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.509782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.510937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.511404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.511841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] PATH_INFO: `/v3/projects/a7b7b266a38843b0aaa7693b0bed2f1d` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.516863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b7b266a38843b0aaa7693b0bed2f1d)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.524264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.555063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 898/1796] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:53:41.574376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.607610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e8d9-fa97-43ac-9d75-892c4cc1db55 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.626024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.627343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.631202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.631202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.672803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.678311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.701300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 899/1797] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:41.784739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.892509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b7b266a38843b0aaa7693b0bed2f1d', 'request_id': 'req-e6d73f87-b1b2-42ab-8215-44ee225130d6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:41.945850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b7b266a38843b0aaa7693b0bed2f1d', 'request_id': 'req-e6d73f87-b1b2-42ab-8215-44ee225130d6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.080222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b7b266a38843b0aaa7693b0bed2f1d', 'request_id': 'req-e6d73f87-b1b2-42ab-8215-44ee225130d6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.128605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] The token cache is being invalidate because project a7b7b266a38843b0aaa7693b0bed2f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:42.128605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.128605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.137521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 899/1798] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:40 2022] DELETE /identity/v3/projects/a7b7b266a38843b0aaa7693b0bed2f1d => generated 0 bytes in 1294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:42.141700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.143607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:42.188768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c1d5b-b9bd-4d04-b0a3-772589b02fb5 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.430681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.431925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.433841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.433841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] PATH_INFO: `/v3/users/16d3fea0c94e4852b7322bd934ad5fb5` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.436078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d3fea0c94e4852b7322bd934ad5fb5)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.447250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.746582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.749403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:42.827618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73f87-b1b2-42ab-8215-44ee225130d6 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.848702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.855128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.855128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.855128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] PATH_INFO: `/v3/projects/dc8a0308489c44fbb8445788f4efc1f6` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.857066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8a0308489c44fbb8445788f4efc1f6)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.861277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.898760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d3fea0c94e4852b7322bd934ad5fb5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.936512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d3fea0c94e4852b7322bd934ad5fb5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:42.939749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d3fea0c94e4852b7322bd934ad5fb5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.002120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d3fea0c94e4852b7322bd934ad5fb5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.022690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.110693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8a0308489c44fbb8445788f4efc1f6', 'request_id': 'req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.132225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8a0308489c44fbb8445788f4efc1f6', 'request_id': 'req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.148264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d3fea0c94e4852b7322bd934ad5fb5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.156339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 900/1799] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:42 2022] DELETE /identity/v3/users/16d3fea0c94e4852b7322bd934ad5fb5 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:43.159279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.162136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:43.245179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8a0308489c44fbb8445788f4efc1f6', 'request_id': 'req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.355655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955996-fb03-43aa-a320-bf5a00a4bb0a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.377856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.377856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.377856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.377856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] PATH_INFO: `/v3/users/f13ebfb50fe249a9a01838a739e223a5` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.378415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13ebfb50fe249a9a01838a739e223a5)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.378415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.412972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] The token cache is being invalidate because project dc8a0308489c44fbb8445788f4efc1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:43.417577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.420085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.425694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 900/1800] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:42 2022] DELETE /identity/v3/projects/dc8a0308489c44fbb8445788f4efc1f6 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:43.432342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.439063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:43.608934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ab90-3ae8-42f1-86a9-18e7e0bacebc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.636964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.641810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.642110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.642414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] PATH_INFO: `/v3/users/d6bd8399db254f73b33e8c008c017e01` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.650740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bd8399db254f73b33e8c008c017e01)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.667123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.708461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13ebfb50fe249a9a01838a739e223a5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.736144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13ebfb50fe249a9a01838a739e223a5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.737071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13ebfb50fe249a9a01838a739e223a5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.767105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13ebfb50fe249a9a01838a739e223a5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.903940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-578fa662-d02c-411d-a5fa-1d5293f6b2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13ebfb50fe249a9a01838a739e223a5'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.905166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 901/1801] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:43 2022] DELETE /identity/v3/users/f13ebfb50fe249a9a01838a739e223a5 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:43.912170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461fea-273a-4cd7-8841-361612865534 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.913087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461fea-273a-4cd7-8841-361612865534 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.913814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461fea-273a-4cd7-8841-361612865534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.952697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bd8399db254f73b33e8c008c017e01'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.955787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bd8399db254f73b33e8c008c017e01'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.963460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.976815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bd8399db254f73b33e8c008c017e01'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:43.984067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bd8399db254f73b33e8c008c017e01'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:44.002000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-82461fea-273a-4cd7-8841-361612865534 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:44.007617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-82461fea-273a-4cd7-8841-361612865534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:44.021535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bd8399db254f73b33e8c008c017e01'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:44.131728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 901/1802] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:43 2022] DELETE /identity/v3/users/d6bd8399db254f73b33e8c008c017e01 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:44.167301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 902/1803] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:44.242652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.244716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:44.449003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d118c9-ddca-401f-a183-07037be92d2a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.513635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.514280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.514567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.514846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.669683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.676822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.723478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 902/1804] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:44.923734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82461fea-273a-4cd7-8841-361612865534 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.926121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-82461fea-273a-4cd7-8841-361612865534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:44.981823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.983852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82461fea-273a-4cd7-8841-361612865534 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.984183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:45.002634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.005077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105f54-cea1-4393-9e92-ed8d3007f4ac service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.007222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.008925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.009240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] PATH_INFO: `/v3/users/6d84771953d44ff387df7e700f45435f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.012639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.013738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.014438 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.015281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] PATH_INFO: `/v3/projects/a6ade0da4e1c447a9c3c0deb802c059c` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.015486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d84771953d44ff387df7e700f45435f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.023297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ade0da4e1c447a9c3c0deb802c059c)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:45.027720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.033469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:45.058386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:45.343955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d84771953d44ff387df7e700f45435f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.374735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ade0da4e1c447a9c3c0deb802c059c', 'request_id': 'req-3ef80c11-b554-414c-a4b0-1204d513ce82'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.383953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d84771953d44ff387df7e700f45435f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.388160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d84771953d44ff387df7e700f45435f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.395964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ade0da4e1c447a9c3c0deb802c059c', 'request_id': 'req-3ef80c11-b554-414c-a4b0-1204d513ce82'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.421745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d84771953d44ff387df7e700f45435f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.490205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ade0da4e1c447a9c3c0deb802c059c', 'request_id': 'req-3ef80c11-b554-414c-a4b0-1204d513ce82'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.510265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] The token cache is being invalidate because project a6ade0da4e1c447a9c3c0deb802c059c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:45.510919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.516647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.520995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 903/1805] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:44 2022] DELETE /identity/v3/projects/a6ade0da4e1c447a9c3c0deb802c059c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:45.523155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.544490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:45.629157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-876eeca5-4186-4ba2-981b-a797032155b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d84771953d44ff387df7e700f45435f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:45.660163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 903/1806] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:44 2022] DELETE /identity/v3/users/6d84771953d44ff387df7e700f45435f => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:45.660163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ed818-7828-4eff-bd53-c08fcb7ed7ba None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.660163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ed818-7828-4eff-bd53-c08fcb7ed7ba None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.660699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ed818-7828-4eff-bd53-c08fcb7ed7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.719483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a72ed818-7828-4eff-bd53-c08fcb7ed7ba None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:45.722390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a72ed818-7828-4eff-bd53-c08fcb7ed7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:45.875018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef80c11-b554-414c-a4b0-1204d513ce82 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.937122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 904/1807] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:45.938804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ddaf4-2cd9-4d65-ac09-97f072a37929 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.939391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ddaf4-2cd9-4d65-ac09-97f072a37929 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.939968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ddaf4-2cd9-4d65-ac09-97f072a37929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.982192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-597ddaf4-2cd9-4d65-ac09-97f072a37929 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:45.983904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-597ddaf4-2cd9-4d65-ac09-97f072a37929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.013805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 905/1808] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:46.015919 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c06e8-496b-4f97-8f3a-f79fe51ec008 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.016689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c06e8-496b-4f97-8f3a-f79fe51ec008 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.017277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c06e8-496b-4f97-8f3a-f79fe51ec008 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.020463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 906/1809] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:53:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:46.021987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca22b-4cac-41d3-b562-9c4b44e90517 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.022979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca22b-4cac-41d3-b562-9c4b44e90517 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.023907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca22b-4cac-41d3-b562-9c4b44e90517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.065895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.088643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-25fca22b-4cac-41d3-b562-9c4b44e90517 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.090026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-25fca22b-4cac-41d3-b562-9c4b44e90517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.105380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 907/1810] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:46.107123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.107992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.109398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.170475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.172755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.188247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.189007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.193232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.193232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] PATH_INFO: `/v3/projects/ade368c2df6e4ccc9363b8a888910a70` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.193232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade368c2df6e4ccc9363b8a888910a70)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.193603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.313771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 908/1811] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:46.314711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.316103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.381218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cfdea-f2c0-4cfc-88ef-529390c5a122 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.385186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.385859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.386128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.386401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.409839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.412741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.416157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade368c2df6e4ccc9363b8a888910a70', 'request_id': 'req-c8ec2204-0c11-4820-b680-55635c5be861'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.423053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade368c2df6e4ccc9363b8a888910a70', 'request_id': 'req-c8ec2204-0c11-4820-b680-55635c5be861'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.435495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 909/1812] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:46.436494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.447213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a96e-1c49-402d-b194-067c1077a787 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.512863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade368c2df6e4ccc9363b8a888910a70', 'request_id': 'req-c8ec2204-0c11-4820-b680-55635c5be861'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.529740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] The token cache is being invalidate because project ade368c2df6e4ccc9363b8a888910a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:46.529740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.531292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.534803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 904/1813] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:45 2022] DELETE /identity/v3/projects/ade368c2df6e4ccc9363b8a888910a70 => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:46.536289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.540063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.550230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.551107 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.551697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.552128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.553229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:46.553644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.555722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.570323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 910/1814] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:46.571177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.574537 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.588732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ecde-8c62-4e02-9c2d-6d54b8508a98 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.594265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.598441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.599492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.599723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.605058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] PATH_INFO: `/v3/projects/3c197f0a049144e0af77ca87adfe32df` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.605058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c197f0a049144e0af77ca87adfe32df)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.606853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.665575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec2204-0c11-4820-b680-55635c5be861 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.671429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581245-f14b-41ad-8122-7288a68b2484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.672047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581245-f14b-41ad-8122-7288a68b2484 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.672324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581245-f14b-41ad-8122-7288a68b2484 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.672596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581245-f14b-41ad-8122-7288a68b2484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.674477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-12581245-f14b-41ad-8122-7288a68b2484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.688689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581245-f14b-41ad-8122-7288a68b2484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.690336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581245-f14b-41ad-8122-7288a68b2484 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.703827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 905/1815] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:46.704093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7862-1e95-46e6-9543-30c8f47eb6b9 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.704093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7862-1e95-46e6-9543-30c8f47eb6b9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.704605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7862-1e95-46e6-9543-30c8f47eb6b9 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.706193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 906/1816] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:46.707336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.707673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.707952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.731175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.732547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.763455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c197f0a049144e0af77ca87adfe32df', 'request_id': 'req-4c02998e-06ae-442a-8e4c-46b693d2d6ef'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.783228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c197f0a049144e0af77ca87adfe32df', 'request_id': 'req-4c02998e-06ae-442a-8e4c-46b693d2d6ef'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.808187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 907/1817] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:46.809264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.816553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.831266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b17d84-c943-4caf-86a8-801f9e10b2cf None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.838101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57eefe-7980-43c4-ab81-c36ed9efaf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.838935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57eefe-7980-43c4-ab81-c36ed9efaf72 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.839299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57eefe-7980-43c4-ab81-c36ed9efaf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.839986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57eefe-7980-43c4-ab81-c36ed9efaf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.840456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57eefe-7980-43c4-ab81-c36ed9efaf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.843065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57eefe-7980-43c4-ab81-c36ed9efaf72 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.914760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c197f0a049144e0af77ca87adfe32df', 'request_id': 'req-4c02998e-06ae-442a-8e4c-46b693d2d6ef'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.930422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] The token cache is being invalidate because project 3c197f0a049144e0af77ca87adfe32df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:46.930694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.931257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4c02998e-06ae-442a-8e4c-46b693d2d6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:46.932845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 911/1818] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:46 2022] DELETE /identity/v3/projects/3c197f0a049144e0af77ca87adfe32df => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:46.934309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.934586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.934854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.965845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.967084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.986096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 908/1819] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:46.987245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.987559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.987829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.010502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:47.011910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.056180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 912/1820] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:47.057268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.058671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.089365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69d44-cfeb-4004-9ad2-6c4793987727 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.089365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.089365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.089365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.090004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] PATH_INFO: `/v3/users/e1664577ab50498e857bb7d81dad2c4c` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.090004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1664577ab50498e857bb7d81dad2c4c)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.090139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 909/1821] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:47.090139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.090259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.090322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.102357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcaa96-5e1d-4171-ad88-bfdce180c14f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.110927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.111930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.112276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.112940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.113259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.116320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.258348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 910/1822] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:47 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:47.258348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.258348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.355915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cbe6d-7682-4295-b647-e237b7c9bcd8 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.368895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1664577ab50498e857bb7d81dad2c4c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.369082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.369709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.370061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.370413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.382207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1664577ab50498e857bb7d81dad2c4c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.383188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1664577ab50498e857bb7d81dad2c4c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.385009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.390404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.393426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.403436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1664577ab50498e857bb7d81dad2c4c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.406620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 911/1823] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:47.407398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.413127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.429349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7f99-068a-4255-8aa5-f046cd220b67 service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.436484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.437165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.437585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.437960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] PATH_INFO: `/v3/projects/35db02a695bc4bfea8c226fc79848e16` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.439444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35db02a695bc4bfea8c226fc79848e16)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.443069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.490683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1664577ab50498e857bb7d81dad2c4c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.502073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 913/1824] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:47 2022] DELETE /identity/v3/users/e1664577ab50498e857bb7d81dad2c4c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:47.502903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.509304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.581663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba529dcf-ba9a-451e-a7b1-67a98de49b59 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.586457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.587631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.587631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.587954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.588491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.588816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.590462 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.610442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 914/1825] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.610442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.613209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.626795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35db02a695bc4bfea8c226fc79848e16', 'request_id': 'req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.629615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5f0f1-9836-427e-98b1-b928c3e28ce8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.633593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35db02a695bc4bfea8c226fc79848e16', 'request_id': 'req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.698412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.699045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.699377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.699673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.700408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.702021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.708837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35db02a695bc4bfea8c226fc79848e16', 'request_id': 'req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.715744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 915/1826] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:47.715744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.721365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] The token cache is being invalidate because project 35db02a695bc4bfea8c226fc79848e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:47.721701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.722372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:47.727645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 912/1827] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:47 2022] DELETE /identity/v3/projects/35db02a695bc4bfea8c226fc79848e16 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:47.728257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d0c0-4e26-4ae5-bd99-7e0a4eea9793 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.728403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.729961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.734720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.735810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.749787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.749787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.749787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.749787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.750188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6ff3-cbc3-4cad-8f4f-bee452850db3 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.752178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.752810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.753092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.753374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.754037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.758042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.773405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 913/1828] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:47.773405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.773405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.798192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1d65-233c-4002-bd39-a8017be92b72 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.804232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.805037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.805554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.805874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] PATH_INFO: `/v3/users/9954a5d1b2a349feaf702222f73edd17` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.807483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9954a5d1b2a349feaf702222f73edd17)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.810105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.858566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 916/1829] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:47 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:47.859987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.938792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b14f-fcb6-483d-8bfd-ad6a3e03c09c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.946061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.947024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.958152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.958152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] PATH_INFO: `/v3/projects/4f158f9e9c3247459eaff5c795945d0f/users/3bbb8f5c840140c8890c3111f3eb2b90/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.958152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.970345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f158f9e9c3247459eaff5c795945d0f, user_id=3bbb8f5c840140c8890c3111f3eb2b90, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.973743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.166817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 917/1830] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:47 2022] PUT /identity/v3/projects/4f158f9e9c3247459eaff5c795945d0f/users/3bbb8f5c840140c8890c3111f3eb2b90/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:48.168043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.169669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.181937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9954a5d1b2a349feaf702222f73edd17'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.189518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9954a5d1b2a349feaf702222f73edd17'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.190394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9954a5d1b2a349feaf702222f73edd17'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.191136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9954a5d1b2a349feaf702222f73edd17'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.204145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9954a5d1b2a349feaf702222f73edd17'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.258181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38197a-ce22-4bcb-8e00-2e589d69c1a9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.263350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b000b-b3b9-497f-a8f3-3a4b96b1d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.263994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b000b-b3b9-497f-a8f3-3a4b96b1d339 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.264279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b000b-b3b9-497f-a8f3-3a4b96b1d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.264564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b000b-b3b9-497f-a8f3-3a4b96b1d339 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.265433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b000b-b3b9-497f-a8f3-3a4b96b1d339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.267275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b000b-b3b9-497f-a8f3-3a4b96b1d339 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.347767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 914/1831] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:47 2022] DELETE /identity/v3/users/9954a5d1b2a349feaf702222f73edd17 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:48.347767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.347767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.388188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 918/1832] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:48 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:48.390891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.393144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.393144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.438856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] MFA Rules not processed for user `3bbb8f5c840140c8890c3111f3eb2b90`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:48.438856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.442708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ebede-566c-4b93-8429-83299c867de1 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.458250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.458625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.458905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.459178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] PATH_INFO: `/v3/projects/144f440e53fa448ba6addd19fccf5da7` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.466629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=144f440e53fa448ba6addd19fccf5da7)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.469411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.556612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 919/1833] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:48.556612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.556612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.566611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134447c-46b6-4799-b80a-fa1ecc06024f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.572142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.572718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.573022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.573298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.573958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.575610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.587061 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 920/1834] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:48.591047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.591047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.603384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be000-c4ca-40b4-8b45-aa19ffaa78d2 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.608356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.608964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.609294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.609591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.610226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.612165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.630271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.650763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144f440e53fa448ba6addd19fccf5da7', 'request_id': 'req-5c74fe8e-54ca-497a-818e-e2e8647873d4'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.659915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144f440e53fa448ba6addd19fccf5da7', 'request_id': 'req-5c74fe8e-54ca-497a-818e-e2e8647873d4'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.744881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 921/1835] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:48 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:48.745688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.747458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144f440e53fa448ba6addd19fccf5da7', 'request_id': 'req-5c74fe8e-54ca-497a-818e-e2e8647873d4'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.766720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] The token cache is being invalidate because project 144f440e53fa448ba6addd19fccf5da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:48.766875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.769052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:48.777394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 915/1836] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:48 2022] DELETE /identity/v3/projects/144f440e53fa448ba6addd19fccf5da7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:48.777394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.777394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.833871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd7e7-010c-42fe-a76d-b68cb3aec96b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.840117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094ab37-6790-44e2-86e8-f2249ee4eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.840836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094ab37-6790-44e2-86e8-f2249ee4eda2 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.841126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094ab37-6790-44e2-86e8-f2249ee4eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.841588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094ab37-6790-44e2-86e8-f2249ee4eda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.842340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094ab37-6790-44e2-86e8-f2249ee4eda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.844332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094ab37-6790-44e2-86e8-f2249ee4eda2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.856846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 922/1837] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:48.858851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.859289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.859798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.885130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74fe8e-54ca-497a-818e-e2e8647873d4 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.886760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:48.888031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.890433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46e5e8-c8ef-44cf-bc38-8f957aabbcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.891058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e5e8-c8ef-44cf-bc38-8f957aabbcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.891554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e5e8-c8ef-44cf-bc38-8f957aabbcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.891844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e5e8-c8ef-44cf-bc38-8f957aabbcb6 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.892540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46e5e8-c8ef-44cf-bc38-8f957aabbcb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.895757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46e5e8-c8ef-44cf-bc38-8f957aabbcb6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.897336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 923/1838] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:48.898218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.899711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:48.917218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716ee5-b776-4be2-b0e8-96e54e7eba3d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.921098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.921778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.922054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.922329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] PATH_INFO: `/v3/projects/828d9eff6b0c4c91bf85cd935d5b85bb/users/972214399e0b4321ac5b876a67bf7055/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.943807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=828d9eff6b0c4c91bf85cd935d5b85bb, user_id=972214399e0b4321ac5b876a67bf7055, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.946685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.036017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 916/1839] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:48 2022] POST /identity/v3/users => generated 291 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:49.039031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.039528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.040024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.060539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.061779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.071165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 917/1840] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:49.077654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.077654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.080978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 924/1841] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:48 2022] PUT /identity/v3/projects/828d9eff6b0c4c91bf85cd935d5b85bb/users/972214399e0b4321ac5b876a67bf7055/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:49.081832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.091789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10589413-66b3-445e-9143-bc24e21ac7cd None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.187998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.189203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.189320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2dd5-3c2a-46d0-9ced-4d14f2076a7c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.189964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.190775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] PATH_INFO: `/v3/projects/8750f437413b427b84b586600954e4a2` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.193363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8750f437413b427b84b586600954e4a2)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.197208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.198612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.199654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.200323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.200545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.204597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.212077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.230033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 925/1842] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:49.231713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.245775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.250603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46af0d-5351-4928-b310-3797ff110652 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.256980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510866c-dcb8-4125-a0c4-b8b6b7dbe9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.257735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510866c-dcb8-4125-a0c4-b8b6b7dbe9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.258113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510866c-dcb8-4125-a0c4-b8b6b7dbe9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.258547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510866c-dcb8-4125-a0c4-b8b6b7dbe9f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.259263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510866c-dcb8-4125-a0c4-b8b6b7dbe9f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:49.259662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510866c-dcb8-4125-a0c4-b8b6b7dbe9f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.261347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510866c-dcb8-4125-a0c4-b8b6b7dbe9f5 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.278589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 926/1843] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:49.280022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793e2b8-b033-45af-9738-7bd26b079482 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.280379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793e2b8-b033-45af-9738-7bd26b079482 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.280715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793e2b8-b033-45af-9738-7bd26b079482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.312522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f793e2b8-b033-45af-9738-7bd26b079482 None None] MFA Rules not processed for user `972214399e0b4321ac5b876a67bf7055`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.313771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f793e2b8-b033-45af-9738-7bd26b079482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.333890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8750f437413b427b84b586600954e4a2', 'request_id': 'req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.341465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8750f437413b427b84b586600954e4a2', 'request_id': 'req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.354078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.402807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 927/1844] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:49.404322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793e2b8-b033-45af-9738-7bd26b079482 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.417653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793e2b8-b033-45af-9738-7bd26b079482 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.450612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8750f437413b427b84b586600954e4a2', 'request_id': 'req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.471066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] The token cache is being invalidate because project 8750f437413b427b84b586600954e4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:49.471559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.473483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:49.476458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 918/1845] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:49 2022] DELETE /identity/v3/projects/8750f437413b427b84b586600954e4a2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:49.477653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.481973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.483309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.484034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.484324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.484607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] PATH_INFO: `/v3/projects/ea90c4288eeb404da654da537a635aa3/users/bf699bce71284dbf9bf856b53fa2f2bb/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.498621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f58b-888a-41f8-b9cc-901bb3ee34a2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.502516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea90c4288eeb404da654da537a635aa3, user_id=bf699bce71284dbf9bf856b53fa2f2bb, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.506162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4189936-bfca-4972-b043-bd361c91d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.506310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.506448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189936-bfca-4972-b043-bd361c91d868 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.506698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189936-bfca-4972-b043-bd361c91d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.506973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189936-bfca-4972-b043-bd361c91d868 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.507653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4189936-bfca-4972-b043-bd361c91d868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.509674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4189936-bfca-4972-b043-bd361c91d868 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.593787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 928/1846] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:49 2022] PUT /identity/v3/projects/ea90c4288eeb404da654da537a635aa3/users/bf699bce71284dbf9bf856b53fa2f2bb/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:49.593787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.593787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.612812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 919/1847] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:49.614177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.614464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.614746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.651694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.653075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.756077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986f935-93e6-4915-be35-831d9f5f7baf admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.760187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.806945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.826444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 920/1848] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:49.827490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.829400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.849623 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5633d6-1613-492d-8a33-58d28ede334c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.862559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.862830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01102ab-a3a8-4c84-bd2a-32871713cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.863189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.863596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.864247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01102ab-a3a8-4c84-bd2a-32871713cc7a admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.864379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01102ab-a3a8-4c84-bd2a-32871713cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.864506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.864656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01102ab-a3a8-4c84-bd2a-32871713cc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.865261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.865426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01102ab-a3a8-4c84-bd2a-32871713cc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.866917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.867223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01102ab-a3a8-4c84-bd2a-32871713cc7a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.878119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 921/1849] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:49.879782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.892346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe390b-2864-43a4-971d-1bb17c4cf528 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.900751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.901802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.902311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.902814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.904106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.907811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.030039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 929/1850] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/projects => generated 381 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:50.031303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346624-a6e6-4280-b7a8-d9c3220b11c5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.031704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346624-a6e6-4280-b7a8-d9c3220b11c5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.032076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346624-a6e6-4280-b7a8-d9c3220b11c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.059060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ae346624-a6e6-4280-b7a8-d9c3220b11c5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:50.060602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ae346624-a6e6-4280-b7a8-d9c3220b11c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:50.099892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 922/1851] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:50.101154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.116831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff26972-0812-4a64-93c4-6c3d0c7201b5 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.164875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.192275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 930/1852] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:50.192275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346624-a6e6-4280-b7a8-d9c3220b11c5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.195257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.196059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.196423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.196797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] PATH_INFO: `/v3/projects/ea90c4288eeb404da654da537a635aa3/users/bf699bce71284dbf9bf856b53fa2f2bb/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.198829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea90c4288eeb404da654da537a635aa3, user_id=bf699bce71284dbf9bf856b53fa2f2bb, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.201559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.206953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346624-a6e6-4280-b7a8-d9c3220b11c5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.217185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 923/1853] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:50 2022] PUT /identity/v3/projects/ea90c4288eeb404da654da537a635aa3/users/bf699bce71284dbf9bf856b53fa2f2bb/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:50.220291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.309795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.311066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.311846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.312597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.313984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.322406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.333273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1e210-1885-463e-9e33-50570a0b4749 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.344812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.344812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.344812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.344812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.345243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.349617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.375627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 924/1854] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:50.376873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.388877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e41167-121c-4292-aec7-93df32bec932 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.396239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ebe5-78dc-475c-8cb2-f24f7df1aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.397586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ebe5-78dc-475c-8cb2-f24f7df1aeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.398076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ebe5-78dc-475c-8cb2-f24f7df1aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.408115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ebe5-78dc-475c-8cb2-f24f7df1aeb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.408115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ebe5-78dc-475c-8cb2-f24f7df1aeb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.408115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ebe5-78dc-475c-8cb2-f24f7df1aeb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.408115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ebe5-78dc-475c-8cb2-f24f7df1aeb9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.442440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 925/1855] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.443972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c110e7-319b-4c44-a02b-50f7e1c0eabe None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.444264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c110e7-319b-4c44-a02b-50f7e1c0eabe None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.444551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c110e7-319b-4c44-a02b-50f7e1c0eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.465290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.472026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 931/1856] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:50 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:50.473670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.489155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764388fc-a109-4cea-82b3-e0ca50ba3c7c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.491787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e5c110e7-319b-4c44-a02b-50f7e1c0eabe None None] MFA Rules not processed for user `bf699bce71284dbf9bf856b53fa2f2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:50.493075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e5c110e7-319b-4c44-a02b-50f7e1c0eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:50.517060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.517968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.518255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.518543 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.519216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.521449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.543341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 932/1857] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:50.545221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.565079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247267b-cf98-41aa-9cf2-187540e77d20 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.570636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.578616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.579661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.580352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.581018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.582522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.588438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.634686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 926/1858] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:50.639512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c110e7-319b-4c44-a02b-50f7e1c0eabe None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.660998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c110e7-319b-4c44-a02b-50f7e1c0eabe None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.668802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.669684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.669986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.670368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.671465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.673563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.690444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 927/1859] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:50.694397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.694518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 933/1860] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:50 2022] POST /identity/v3/projects => generated 389 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:50.694993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.699947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:50.711216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a149a3e-9d1f-42e0-8e4a-858b6acd44a1 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.755565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.789453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.827738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff89aec-5ade-4ba4-97f2-a93756f815f9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.830303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.832375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.832375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.832375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] PATH_INFO: `/v3/projects/6f6320b752c94f74993d62f4988c078f/users/0e21c4edb9c8401a9e4f17a11d76ae70/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.833172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.833876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.834285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.834672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.857053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6320b752c94f74993d62f4988c078f, user_id=0e21c4edb9c8401a9e4f17a11d76ae70, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.861615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.944878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.946433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.959912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 934/1861] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:50.960797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.982029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc107b-27e1-4bf5-87bd-7705644420d3 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.017376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.022164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.022164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.022164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] PATH_INFO: `/v3/projects/d80c5a1de9d2494fa9ef2f5461e40fb5/users/d116ea050dd54672835e33290f7e3e17/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.056549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80c5a1de9d2494fa9ef2f5461e40fb5, user_id=d116ea050dd54672835e33290f7e3e17, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.060902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.083424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 928/1862] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:50 2022] PUT /identity/v3/projects/6f6320b752c94f74993d62f4988c078f/users/0e21c4edb9c8401a9e4f17a11d76ae70/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:51.086318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.217030 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732234e-2789-4c16-9ba8-15af925059de admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.228029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 935/1863] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:50 2022] PUT /identity/v3/projects/d80c5a1de9d2494fa9ef2f5461e40fb5/users/d116ea050dd54672835e33290f7e3e17/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:51.238114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.250317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:51.369059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc2908-230f-40db-ad46-d6ae7c48fc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.369985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2908-230f-40db-ad46-d6ae7c48fc85 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.370444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2908-230f-40db-ad46-d6ae7c48fc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.376896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2908-230f-40db-ad46-d6ae7c48fc85 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.376896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc2908-230f-40db-ad46-d6ae7c48fc85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.376896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc2908-230f-40db-ad46-d6ae7c48fc85 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.379005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.435348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508def-fdd8-443a-bd88-ef9fb1f35dc2 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.451140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.451879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.452518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.452805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.458386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:51.534537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.557757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 929/1864] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:51 2022] POST /identity/v3/users => generated 295 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:51.563716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859e0a-6325-4936-bc21-1093a20c0832 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.563716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859e0a-6325-4936-bc21-1093a20c0832 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.563716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859e0a-6325-4936-bc21-1093a20c0832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.677360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-72859e0a-6325-4936-bc21-1093a20c0832 None None] MFA Rules not processed for user `0e21c4edb9c8401a9e4f17a11d76ae70`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:51.685058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-72859e0a-6325-4936-bc21-1093a20c0832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:51.827067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.838262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.899644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 930/1865] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:51.902218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859e0a-6325-4936-bc21-1093a20c0832 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.915751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 936/1866] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:51.917710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.965678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877995c-28d5-4387-aa57-63cbbfcceb33 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.994375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859e0a-6325-4936-bc21-1093a20c0832 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.999638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.001539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.005705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.007335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.015399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.024647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.029610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.032997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.033334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.033909 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.037215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.044125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.070205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 937/1867] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:52.071657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.094169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 931/1868] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:52.096049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.127903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e08bcd-b839-4c89-958c-30142a109192 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.150509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.156269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.158109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.158261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f935-1996-4ef8-9652-bd69b0ca72b9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.158474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.159162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.164260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.182130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.183342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.183997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.184570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.185835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.193175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.236672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 932/1869] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:52.236672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.277930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f6aea-9df5-4afd-94e8-5ac32ca86af6 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.298746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.299920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.300406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.300871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] PATH_INFO: `/v3/projects/d80c5a1de9d2494fa9ef2f5461e40fb5/users/d116ea050dd54672835e33290f7e3e17/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.308846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80c5a1de9d2494fa9ef2f5461e40fb5, user_id=d116ea050dd54672835e33290f7e3e17, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.318898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.369279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 938/1870] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:52 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:52.369279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.369533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 933/1871] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:52 2022] PUT /identity/v3/projects/d80c5a1de9d2494fa9ef2f5461e40fb5/users/d116ea050dd54672835e33290f7e3e17/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:52.380473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.568752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cfba4-28ae-4d23-8c24-9aaec506ea9f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.590405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8933f6-55ea-415b-aea1-cd297c27b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.594558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8933f6-55ea-415b-aea1-cd297c27b9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.597461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8933f6-55ea-415b-aea1-cd297c27b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.599616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8933f6-55ea-415b-aea1-cd297c27b9a9 admin admin] PATH_INFO: `/v3/projects/935fd0f885334152b55856c5c628cabd/users/fa79d3e2871b4c53962f98e4332034ab/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.640577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc832fb5-dfa0-4e45-a95b-ff025d73d442 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.651845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8933f6-55ea-415b-aea1-cd297c27b9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935fd0f885334152b55856c5c628cabd, user_id=fa79d3e2871b4c53962f98e4332034ab, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.655441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8933f6-55ea-415b-aea1-cd297c27b9a9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.656926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ba562-e646-44d6-92e9-d9042109ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.659557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba562-e646-44d6-92e9-d9042109ea7b admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.668034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba562-e646-44d6-92e9-d9042109ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.668559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba562-e646-44d6-92e9-d9042109ea7b admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.669762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ba562-e646-44d6-92e9-d9042109ea7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.675632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ba562-e646-44d6-92e9-d9042109ea7b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.797591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 939/1872] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:52 2022] PUT /identity/v3/projects/935fd0f885334152b55856c5c628cabd/users/fa79d3e2871b4c53962f98e4332034ab/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:52.797591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61545c-ce6a-45cf-97cb-6186f9e91c10 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.797591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61545c-ce6a-45cf-97cb-6186f9e91c10 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.797591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61545c-ce6a-45cf-97cb-6186f9e91c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.845638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 934/1873] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:52 2022] POST /identity/v3/users => generated 300 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:52.845638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2ae46-7e9c-4cfb-891d-2bc1b5cc3b4c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.845638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2ae46-7e9c-4cfb-891d-2bc1b5cc3b4c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.845638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2ae46-7e9c-4cfb-891d-2bc1b5cc3b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.916704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-5ed2ae46-7e9c-4cfb-891d-2bc1b5cc3b4c None None] MFA Rules not processed for user `fa79d3e2871b4c53962f98e4332034ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:52.927380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5ed2ae46-7e9c-4cfb-891d-2bc1b5cc3b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:52.931345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4d61545c-ce6a-45cf-97cb-6186f9e91c10 None None] MFA Rules not processed for user `d116ea050dd54672835e33290f7e3e17`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:52.933916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4d61545c-ce6a-45cf-97cb-6186f9e91c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:53.001648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.086279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.115747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 935/1874] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:53.115747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2ae46-7e9c-4cfb-891d-2bc1b5cc3b4c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.246233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 940/1875] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:53.247958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61545c-ce6a-45cf-97cb-6186f9e91c10 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.322820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2ae46-7e9c-4cfb-891d-2bc1b5cc3b4c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.339511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.340528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.341354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.342098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.343936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.349198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.398463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 936/1876] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:53.400513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.557526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2f8a-2672-420e-9d36-b5504aea23a0 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.563689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.565791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.566326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.566888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.583882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.589718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.603900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61545c-ce6a-45cf-97cb-6186f9e91c10 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.616580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.617593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.618062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.618508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.621159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.624283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 937/1877] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:53.625067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.625819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.640308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022f65-cc9c-45a8-b6d2-1fb8b380fd85 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.653274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.659697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.659697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.659697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] PATH_INFO: `/v3/projects/9824ce175b064490a1b89c1a673b0e8e/users/99aaa06668444b37b5b16c8b18643a72/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.682804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9824ce175b064490a1b89c1a673b0e8e, user_id=99aaa06668444b37b5b16c8b18643a72, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.687045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.765999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 941/1878] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:53:53 2022] POST /identity/v3/projects => generated 389 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:53.772517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.824976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 938/1879] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:53 2022] PUT /identity/v3/projects/9824ce175b064490a1b89c1a673b0e8e/users/99aaa06668444b37b5b16c8b18643a72/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:53.838678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.977969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.011348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae869-ba3a-498d-83b4-ad39be3c18d5 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.021777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.022984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.024004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366adb5-6ccc-4e19-a9b0-6852f3ce9e6d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.024595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.025299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.028017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.032218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.036041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d66034-1d80-429b-b91a-971b22c5aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.037461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66034-1d80-429b-b91a-971b22c5aada admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.037461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66034-1d80-429b-b91a-971b22c5aada admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.038001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66034-1d80-429b-b91a-971b22c5aada admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.039574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d66034-1d80-429b-b91a-971b22c5aada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.044637 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d66034-1d80-429b-b91a-971b22c5aada admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.088445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 939/1880] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:54.096837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.138459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf87e-4741-4982-9bfd-c67cf96d5a05 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.165911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.166969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.167490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.173338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] PATH_INFO: `/v3/projects/9824ce175b064490a1b89c1a673b0e8e/users/99aaa06668444b37b5b16c8b18643a72/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.190453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9824ce175b064490a1b89c1a673b0e8e, user_id=99aaa06668444b37b5b16c8b18643a72, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.201341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.233771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 940/1881] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:54 2022] PUT /identity/v3/projects/9824ce175b064490a1b89c1a673b0e8e/users/99aaa06668444b37b5b16c8b18643a72/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:54.239833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 942/1882] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:53 2022] POST /identity/v3/users => generated 301 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:54.240588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.263119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0655e5-1b62-49ed-b6ea-cc50da61c112 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.271888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0655e5-1b62-49ed-b6ea-cc50da61c112 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.272331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0655e5-1b62-49ed-b6ea-cc50da61c112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.439214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0e0655e5-1b62-49ed-b6ea-cc50da61c112 None None] MFA Rules not processed for user `99aaa06668444b37b5b16c8b18643a72`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:54.440126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ee56-b1dc-4d7e-9543-f1a8c9e68da6 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.449636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0e0655e5-1b62-49ed-b6ea-cc50da61c112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:54.458661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.459518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.459918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.460696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.461497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.463675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.492245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 941/1883] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:54.499035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.531355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a7d3d-d783-4f24-8c61-388cd43d0541 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.550147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.555069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.555661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.556848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] PATH_INFO: `/v3/projects/f25fcdf073ff4b0abd2d932a66b1bf16/users/463229d136e94e1cae937208a90b18b8/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.559802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.598591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25fcdf073ff4b0abd2d932a66b1bf16, user_id=463229d136e94e1cae937208a90b18b8, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.601560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.654503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 943/1884] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:54.668504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0655e5-1b62-49ed-b6ea-cc50da61c112 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.707147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 942/1885] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:54 2022] PUT /identity/v3/projects/f25fcdf073ff4b0abd2d932a66b1bf16/users/463229d136e94e1cae937208a90b18b8/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:54.711351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.788809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0655e5-1b62-49ed-b6ea-cc50da61c112 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.859817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41875434-18b5-4230-819e-538cb30b56b4 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.867932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.868970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.869468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.869960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] PATH_INFO: `/v3/users/972214399e0b4321ac5b876a67bf7055` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.872743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=972214399e0b4321ac5b876a67bf7055)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.877537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.878846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.879920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.880209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.880625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.968176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.969949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.981299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 944/1886] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:54.982277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.997240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1322-0a71-42a5-a1b0-b48b81dea350 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.008977 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.009611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.009895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.010168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.010803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.012453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.024955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 945/1887] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:55.029840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.050866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b055a-eee6-49f5-acd5-5980d7139609 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.057734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.058469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.058695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.058969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] PATH_INFO: `/v3/projects/f25fcdf073ff4b0abd2d932a66b1bf16/users/463229d136e94e1cae937208a90b18b8/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.061253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25fcdf073ff4b0abd2d932a66b1bf16, user_id=463229d136e94e1cae937208a90b18b8, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.064773 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.087672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.090879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972214399e0b4321ac5b876a67bf7055'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.092074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972214399e0b4321ac5b876a67bf7055'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.095772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 946/1888] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:53:55 2022] PUT /identity/v3/projects/f25fcdf073ff4b0abd2d932a66b1bf16/users/463229d136e94e1cae937208a90b18b8/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:55.097471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.099737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.103324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972214399e0b4321ac5b876a67bf7055'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.104214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972214399e0b4321ac5b876a67bf7055'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.122708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.149747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-ee135ac4-2fd1-4939-bfaf-c683d07b3cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972214399e0b4321ac5b876a67bf7055'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.203046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1075d-12b9-454d-a454-7f519f4b8051 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.221453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.222118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.222396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.222705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] PATH_INFO: `/v3/users/0e21c4edb9c8401a9e4f17a11d76ae70` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.224067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e21c4edb9c8401a9e4f17a11d76ae70)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.227205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.246535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 943/1889] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:54 2022] DELETE /identity/v3/users/972214399e0b4321ac5b876a67bf7055 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:55.248131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0a6d-518d-4ed2-84c2-335ab9be16ae None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.248668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0a6d-518d-4ed2-84c2-335ab9be16ae None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.249013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0a6d-518d-4ed2-84c2-335ab9be16ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.296203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-2fdf0a6d-518d-4ed2-84c2-335ab9be16ae None None] MFA Rules not processed for user `463229d136e94e1cae937208a90b18b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:55.297846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2fdf0a6d-518d-4ed2-84c2-335ab9be16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.439175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 944/1890] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:55.440828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.441122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.441492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.481584 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:55.483148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.505728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e21c4edb9c8401a9e4f17a11d76ae70'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.518795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e21c4edb9c8401a9e4f17a11d76ae70'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.520988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e21c4edb9c8401a9e4f17a11d76ae70'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.560815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e21c4edb9c8401a9e4f17a11d76ae70'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.607931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 945/1891] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:55.607931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.620895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.656392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e21c4edb9c8401a9e4f17a11d76ae70'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:55.667064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 947/1892] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:55 2022] DELETE /identity/v3/users/0e21c4edb9c8401a9e4f17a11d76ae70 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:55.667787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.674381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.729407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.736713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32899a7-e91b-4b1a-9f44-84dd1d8b6855 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.785736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392f91-aabd-410b-a94d-9ce21d9c076d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.787592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f09875-0f2f-4889-a383-bfc95fbee65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.788215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09875-0f2f-4889-a383-bfc95fbee65f service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.788500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09875-0f2f-4889-a383-bfc95fbee65f service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.788776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09875-0f2f-4889-a383-bfc95fbee65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.791943 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b7f09875-0f2f-4889-a383-bfc95fbee65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.833607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.834819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.835438 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.835881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.839015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.870291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.893459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f09875-0f2f-4889-a383-bfc95fbee65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.898486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f09875-0f2f-4889-a383-bfc95fbee65f service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.915524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 948/1893] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:55.917469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.917840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.918143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.942563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:55.944161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.957998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.959936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.970131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 949/1894] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:55.978048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.983957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.985313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 946/1895] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:56.009528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4181947-7c05-4c80-9deb-cd155a50cb0a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.013898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.014757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.015086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.015316 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.035990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.037853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.083448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 950/1896] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:56.243919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.245557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.271377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc72e0f-17a7-475d-8b65-fac6e5251bec service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.279028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.280171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.280819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.280819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] PATH_INFO: `/v3/users/fa79d3e2871b4c53962f98e4332034ab` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.294051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa79d3e2871b4c53962f98e4332034ab)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.296384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.631997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa79d3e2871b4c53962f98e4332034ab'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.633142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa79d3e2871b4c53962f98e4332034ab'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.642649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa79d3e2871b4c53962f98e4332034ab'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.644037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa79d3e2871b4c53962f98e4332034ab'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.671696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa79d3e2871b4c53962f98e4332034ab'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:56.776652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.778375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.791418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30219b5b-54f5-4783-92a3-161cc4f40a94 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.796057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.796695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.796976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.797249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] PATH_INFO: `/v3/users/3bbb8f5c840140c8890c3111f3eb2b90` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.798420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbb8f5c840140c8890c3111f3eb2b90)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.800403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.873573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 947/1897] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:56 2022] DELETE /identity/v3/users/fa79d3e2871b4c53962f98e4332034ab => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:56.878459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.881647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:56.920110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.986604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2568d6b-3ff8-4720-8e77-fa297cfd0ffa admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.986604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.986604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.986604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.987615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] PATH_INFO: `/v3/projects/828d9eff6b0c4c91bf85cd935d5b85bb` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.988814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] RBAC: Authorizing `identity:delete_project(project_id=828d9eff6b0c4c91bf85cd935d5b85bb)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.990821 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.104599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbb8f5c840140c8890c3111f3eb2b90'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.112855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbb8f5c840140c8890c3111f3eb2b90'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.114235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbb8f5c840140c8890c3111f3eb2b90'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.129506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbb8f5c840140c8890c3111f3eb2b90'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.147523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828d9eff6b0c4c91bf85cd935d5b85bb', 'request_id': 'req-85a10554-a5cc-4ff4-9aed-bac84743314e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.153178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828d9eff6b0c4c91bf85cd935d5b85bb', 'request_id': 'req-85a10554-a5cc-4ff4-9aed-bac84743314e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.255797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b392efc7-0f2b-4674-89d3-67c070e8f05d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbb8f5c840140c8890c3111f3eb2b90'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.263113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 951/1898] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:56 2022] DELETE /identity/v3/users/3bbb8f5c840140c8890c3111f3eb2b90 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:57.268677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccd598-9f63-42bf-a7a8-9cca74bf811c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.268677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccd598-9f63-42bf-a7a8-9cca74bf811c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.268677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccd598-9f63-42bf-a7a8-9cca74bf811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.286337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7dccd598-9f63-42bf-a7a8-9cca74bf811c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:57.287627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7dccd598-9f63-42bf-a7a8-9cca74bf811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:57.324160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828d9eff6b0c4c91bf85cd935d5b85bb', 'request_id': 'req-85a10554-a5cc-4ff4-9aed-bac84743314e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.337756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] The token cache is being invalidate because project 828d9eff6b0c4c91bf85cd935d5b85bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:57.338313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.339006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.343665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 948/1899] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:56 2022] DELETE /identity/v3/projects/828d9eff6b0c4c91bf85cd935d5b85bb => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:57.343665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.346013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:57.385010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 952/1900] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:57.386758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.387025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.387407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.412174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:57.413423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:57.427879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 953/1901] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:57.432311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.433896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:57.446557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdddd2-06ad-4f51-a521-62d8df138b87 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.452042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.452420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a10554-a5cc-4ff4-9aed-bac84743314e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.452858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.453121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.453423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] PATH_INFO: `/v3/users/d116ea050dd54672835e33290f7e3e17` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.459594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d116ea050dd54672835e33290f7e3e17)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.459594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.477192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.477865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.479249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.479643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] PATH_INFO: `/v3/projects/6f6320b752c94f74993d62f4988c078f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.481324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6320b752c94f74993d62f4988c078f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.483575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.489224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.710609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd116ea050dd54672835e33290f7e3e17'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.724681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6320b752c94f74993d62f4988c078f', 'request_id': 'req-fe0725bb-8711-44b9-92ec-76056d2f25df'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.736109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd116ea050dd54672835e33290f7e3e17'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.737887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd116ea050dd54672835e33290f7e3e17'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.739491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.747458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6320b752c94f74993d62f4988c078f', 'request_id': 'req-fe0725bb-8711-44b9-92ec-76056d2f25df'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.767174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd116ea050dd54672835e33290f7e3e17'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.896249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6320b752c94f74993d62f4988c078f', 'request_id': 'req-fe0725bb-8711-44b9-92ec-76056d2f25df'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.923726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] The token cache is being invalidate because project 6f6320b752c94f74993d62f4988c078f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:57.924131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.925841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:57.928390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 949/1902] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:57 2022] DELETE /identity/v3/projects/6f6320b752c94f74993d62f4988c078f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:57.929333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.936828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:58.060553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0725bb-8711-44b9-92ec-76056d2f25df admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.067014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.067014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.067014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.067014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.068994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:58.177176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.178874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.189714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 950/1903] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:58.190602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.192038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:58.203130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db73dc-e7bf-42d6-8332-f83b37c507f8 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.208042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.208675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.208967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.209244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.211129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:58.225007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.226432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.237855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 951/1904] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:53:58.239323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.241024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:58.254506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24865a9-cd23-4ea7-b5d6-32e3a88eec07 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.264747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.265417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.265700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.266121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] PATH_INFO: `/v3/users/99aaa06668444b37b5b16c8b18643a72` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.267995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99aaa06668444b37b5b16c8b18643a72)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.271172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.455683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd116ea050dd54672835e33290f7e3e17'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:58.463520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 954/1905] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:57 2022] DELETE /identity/v3/users/d116ea050dd54672835e33290f7e3e17 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:58.789368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99aaa06668444b37b5b16c8b18643a72'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:58.790482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99aaa06668444b37b5b16c8b18643a72'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:58.823790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99aaa06668444b37b5b16c8b18643a72'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:58.825343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99aaa06668444b37b5b16c8b18643a72'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:58.861509 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99aaa06668444b37b5b16c8b18643a72'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.011476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 952/1906] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:58 2022] DELETE /identity/v3/users/99aaa06668444b37b5b16c8b18643a72 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:59.107548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.109169 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:59.189438 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.192336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:59.218076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90a48d-7b0a-4571-b3f1-5805671839d9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.290877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.315906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.317301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.317430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69734444-fe60-4817-b429-db516c6eda36 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.317653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.317941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] PATH_INFO: `/v3/projects/d80c5a1de9d2494fa9ef2f5461e40fb5` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.319486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80c5a1de9d2494fa9ef2f5461e40fb5)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.321975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.328932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.329853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.330265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.330714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] PATH_INFO: `/v3/projects/935fd0f885334152b55856c5c628cabd` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.333655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] RBAC: Authorizing `identity:delete_project(project_id=935fd0f885334152b55856c5c628cabd)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.336120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.517381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.519270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80c5a1de9d2494fa9ef2f5461e40fb5', 'request_id': 'req-28bc4460-7956-4165-bd4a-bd8693d1e7fb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.527921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80c5a1de9d2494fa9ef2f5461e40fb5', 'request_id': 'req-28bc4460-7956-4165-bd4a-bd8693d1e7fb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.586116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935fd0f885334152b55856c5c628cabd', 'request_id': 'req-aa45de92-f5a5-495c-b3b6-fe548cdeffee'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.598053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935fd0f885334152b55856c5c628cabd', 'request_id': 'req-aa45de92-f5a5-495c-b3b6-fe548cdeffee'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.610629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80c5a1de9d2494fa9ef2f5461e40fb5', 'request_id': 'req-28bc4460-7956-4165-bd4a-bd8693d1e7fb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.627764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] The token cache is being invalidate because project d80c5a1de9d2494fa9ef2f5461e40fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:59.628152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.629496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.631159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 955/1907] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:59 2022] DELETE /identity/v3/projects/d80c5a1de9d2494fa9ef2f5461e40fb5 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:59.631983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.633411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:59.708498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935fd0f885334152b55856c5c628cabd', 'request_id': 'req-aa45de92-f5a5-495c-b3b6-fe548cdeffee'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.723018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] The token cache is being invalidate because project 935fd0f885334152b55856c5c628cabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:53:59.723321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.724068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-aa45de92-f5a5-495c-b3b6-fe548cdeffee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:53:59.729750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 953/1908] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:59 2022] DELETE /identity/v3/projects/935fd0f885334152b55856c5c628cabd => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:59.732102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.732391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.732670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.760417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:59.767947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:59.768109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4460-7956-4165-bd4a-bd8693d1e7fb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.848405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.849466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.849466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.849757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] PATH_INFO: `/v3/projects/4f158f9e9c3247459eaff5c795945d0f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.851089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f158f9e9c3247459eaff5c795945d0f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.853162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.861898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 954/1909] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:53:59.864349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.867417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:59.888698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6b8ca-7260-4b2a-af28-102c7965333f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.896106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.897158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.897645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.898122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] PATH_INFO: `/v3/users/463229d136e94e1cae937208a90b18b8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.900321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=463229d136e94e1cae937208a90b18b8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.903505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.038550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f158f9e9c3247459eaff5c795945d0f', 'request_id': 'req-fbf2cf43-620f-4828-999a-0a60b9b15726'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.050355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f158f9e9c3247459eaff5c795945d0f', 'request_id': 'req-fbf2cf43-620f-4828-999a-0a60b9b15726'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.165156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f158f9e9c3247459eaff5c795945d0f', 'request_id': 'req-fbf2cf43-620f-4828-999a-0a60b9b15726'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.182778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] The token cache is being invalidate because project 4f158f9e9c3247459eaff5c795945d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:00.183298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.184596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fbf2cf43-620f-4828-999a-0a60b9b15726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.190942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 956/1910] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:53:59 2022] DELETE /identity/v3/projects/4f158f9e9c3247459eaff5c795945d0f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:00.190942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.190942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.190942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.194614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463229d136e94e1cae937208a90b18b8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.195834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463229d136e94e1cae937208a90b18b8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.209086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463229d136e94e1cae937208a90b18b8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.210238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463229d136e94e1cae937208a90b18b8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.227187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:00.229377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:00.231720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463229d136e94e1cae937208a90b18b8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.331398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 957/1911] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:00.335080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.338024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:00.357430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 955/1912] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:53:59 2022] DELETE /identity/v3/users/463229d136e94e1cae937208a90b18b8 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:00.357430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.357430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:00.394399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7f98-277b-4435-a613-4df9c16337e2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.446468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd219bd-4d63-4591-b36b-5a894f2c62ce admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.449185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.450192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.450700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.451316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] PATH_INFO: `/v3/users/bf699bce71284dbf9bf856b53fa2f2bb` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.453846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf699bce71284dbf9bf856b53fa2f2bb)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.456052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.477573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.554567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.555793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.556301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.556802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] PATH_INFO: `/v3/projects/9824ce175b064490a1b89c1a673b0e8e` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.559441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9824ce175b064490a1b89c1a673b0e8e)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.563464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.663879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.810410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9824ce175b064490a1b89c1a673b0e8e', 'request_id': 'req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.816426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf699bce71284dbf9bf856b53fa2f2bb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.822643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf699bce71284dbf9bf856b53fa2f2bb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.834089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9824ce175b064490a1b89c1a673b0e8e', 'request_id': 'req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.846997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf699bce71284dbf9bf856b53fa2f2bb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.848724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf699bce71284dbf9bf856b53fa2f2bb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.880619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e7ffde92-6475-43f3-a195-59e37f3e2eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf699bce71284dbf9bf856b53fa2f2bb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.913904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9824ce175b064490a1b89c1a673b0e8e', 'request_id': 'req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.935279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] The token cache is being invalidate because project 9824ce175b064490a1b89c1a673b0e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:00.935595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.936400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:00.939486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 958/1913] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:00 2022] DELETE /identity/v3/projects/9824ce175b064490a1b89c1a673b0e8e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:00.941089 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.953060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:01.063177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29164-e3a0-4ca8-93a7-b12fcb259b18 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.069083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.069911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.070290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.070693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.071642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:01.072126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.072905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 956/1914] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:00 2022] DELETE /identity/v3/users/bf699bce71284dbf9bf856b53fa2f2bb => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:01.075695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f39c9-023f-4453-ab34-e9579f4be5d3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.076317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f39c9-023f-4453-ab34-e9579f4be5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.076926 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f39c9-023f-4453-ab34-e9579f4be5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.078598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.101388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 959/1915] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:01.105809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.129111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03925-806d-4c5a-87ec-3c1a4fbaa288 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.156578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e21f39c9-023f-4453-ab34-e9579f4be5d3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:01.165792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e21f39c9-023f-4453-ab34-e9579f4be5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:01.309425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.315907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.315907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.315907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.315907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.315907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.371614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 957/1916] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:01.386725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d262-9fd1-4485-9c97-9c38d283a21a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.389214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d262-9fd1-4485-9c97-9c38d283a21a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.389214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d262-9fd1-4485-9c97-9c38d283a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.441917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7cf1d262-9fd1-4485-9c97-9c38d283a21a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:01.444142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7cf1d262-9fd1-4485-9c97-9c38d283a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:01.458284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 958/1917] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:01.462403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d262-9fd1-4485-9c97-9c38d283a21a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.473855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d262-9fd1-4485-9c97-9c38d283a21a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.478811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.482527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.482527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.482527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.482527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:01.482527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.483023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.492053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 960/1918] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:01 2022] POST /identity/v3/projects => generated 383 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:01.493752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.507215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 959/1919] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:01.512710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.536631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16819-1b37-4cd4-beb8-57dd68bebab2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.695581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.696640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.697267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.697544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.698709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.704906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.734647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4474302-eb2b-4a4a-be60-3cf2a642b425 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.746339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.749258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.749258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.749558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.750725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.755418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.847939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 960/1920] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:01 2022] POST /identity/v3/projects => generated 365 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:01.849068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.850706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:01.893325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:01.896430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 961/1921] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:01 2022] POST /identity/v3/users => generated 292 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:01.897265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.907974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c864de-922d-4a7b-99ea-294fcf6546b4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.966408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a66c8-acc5-4b6d-9f53-1b44f9e35df2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.976116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.977186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.977647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.978178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] PATH_INFO: `/v3/projects/f25fcdf073ff4b0abd2d932a66b1bf16` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.980491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25fcdf073ff4b0abd2d932a66b1bf16)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.984562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.998981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.999984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.000444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.000846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.001875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.005586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.091081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 962/1922] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:01 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:02.098280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.105702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe663-5ad0-4610-b144-a90f2ffeaa2e admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.121503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25fcdf073ff4b0abd2d932a66b1bf16', 'request_id': 'req-456a9d54-6731-41e9-b82a-261eb349f57e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.129914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25fcdf073ff4b0abd2d932a66b1bf16', 'request_id': 'req-456a9d54-6731-41e9-b82a-261eb349f57e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.171907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.173058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.173346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.173624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.174296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.175988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.189433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 963/1923] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:02.190972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.195924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.218416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cccc1-86e5-490c-b361-b28195ade9eb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.223881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.228810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.256892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.256892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.256892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] PATH_INFO: `/v3/projects/ea90c4288eeb404da654da537a635aa3` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.256892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea90c4288eeb404da654da537a635aa3)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.256892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.273924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25fcdf073ff4b0abd2d932a66b1bf16', 'request_id': 'req-456a9d54-6731-41e9-b82a-261eb349f57e'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.296321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] The token cache is being invalidate because project f25fcdf073ff4b0abd2d932a66b1bf16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:02.297207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.298866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.306647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 961/1924] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:01 2022] DELETE /identity/v3/projects/f25fcdf073ff4b0abd2d932a66b1bf16 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:02.307972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.316172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.342694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea90c4288eeb404da654da537a635aa3', 'request_id': 'req-8b10aa42-c279-4b61-b1c9-9064943e0980'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.345814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a9d54-6731-41e9-b82a-261eb349f57e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.364489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea90c4288eeb404da654da537a635aa3', 'request_id': 'req-8b10aa42-c279-4b61-b1c9-9064943e0980'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.451967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.452989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.453393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.453860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.454735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.458786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.479094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 962/1925] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:02.479094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.479094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.482554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea90c4288eeb404da654da537a635aa3', 'request_id': 'req-8b10aa42-c279-4b61-b1c9-9064943e0980'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.511561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41a34b-1d10-40a6-8a78-0ebf6165f5fc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.520318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] The token cache is being invalidate because project ea90c4288eeb404da654da537a635aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:02.521197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.522924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b10aa42-c279-4b61-b1c9-9064943e0980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:02.524592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.525787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.526308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.526604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 964/1926] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:02 2022] DELETE /identity/v3/projects/ea90c4288eeb404da654da537a635aa3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:02.527005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.528614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.529808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756fa9b-a255-4f46-8d18-8000be28b0cb None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.530848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756fa9b-a255-4f46-8d18-8000be28b0cb None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.531866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.532055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756fa9b-a255-4f46-8d18-8000be28b0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.550845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 963/1927] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:02.552563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.556239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.568421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e756fa9b-a255-4f46-8d18-8000be28b0cb None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.570937 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e756fa9b-a255-4f46-8d18-8000be28b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.575863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc6750-eb99-46d9-bf57-805655010530 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.582396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.583440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.583757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.584140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.585240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.586591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 965/1928] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:02.587423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.588867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf104735-f479-401e-a815-30d520bf11c9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.590284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf104735-f479-401e-a815-30d520bf11c9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.591697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf104735-f479-401e-a815-30d520bf11c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.607648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 964/1929] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:02.609009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.611147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.620887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-cf104735-f479-401e-a815-30d520bf11c9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.623729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cf104735-f479-401e-a815-30d520bf11c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.624999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4735da-d70a-4b1c-a57d-33dd04252873 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.631515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d893c-cd6c-4996-b8e7-f468629ccf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.632205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d893c-cd6c-4996-b8e7-f468629ccf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.632489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d893c-cd6c-4996-b8e7-f468629ccf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.632763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d893c-cd6c-4996-b8e7-f468629ccf8e admin admin] PATH_INFO: `/v3/projects/9df574cd0d674f6c92c071d674505e98/users/7d01dda5cddf45418dc9bb68e3417860/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.638984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 966/1930] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:02.641268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c9c3-87ee-4c01-be7d-1062910b2811 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.641770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c9c3-87ee-4c01-be7d-1062910b2811 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.642268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c9c3-87ee-4c01-be7d-1062910b2811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.651335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d893c-cd6c-4996-b8e7-f468629ccf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df574cd0d674f6c92c071d674505e98, user_id=7d01dda5cddf45418dc9bb68e3417860, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.654177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d893c-cd6c-4996-b8e7-f468629ccf8e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.674833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ed56c9c3-87ee-4c01-be7d-1062910b2811 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.676139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ed56c9c3-87ee-4c01-be7d-1062910b2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.684608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 967/1931] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:02.685427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56c9c3-87ee-4c01-be7d-1062910b2811 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.698763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56c9c3-87ee-4c01-be7d-1062910b2811 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.704610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.705285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.705559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.705838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] PATH_INFO: `/v3/projects/7fee27962fb841169760815f4535a28b/users/3c3c49ed947f4e9b87000fa9f4739a7b/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.722499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fee27962fb841169760815f4535a28b, user_id=3c3c49ed947f4e9b87000fa9f4739a7b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.725333 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.747766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 965/1932] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:02 2022] PUT /identity/v3/projects/9df574cd0d674f6c92c071d674505e98/users/7d01dda5cddf45418dc9bb68e3417860/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:02.755690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9cfe-a9c3-4821-8950-861782c8a5a5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.755690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9cfe-a9c3-4821-8950-861782c8a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.755690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9cfe-a9c3-4821-8950-861782c8a5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.780906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-4a1f9cfe-a9c3-4821-8950-861782c8a5a5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.782157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4a1f9cfe-a9c3-4821-8950-861782c8a5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.813830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 968/1933] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:02 2022] PUT /identity/v3/projects/7fee27962fb841169760815f4535a28b/users/3c3c49ed947f4e9b87000fa9f4739a7b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:02.814733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.872779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 966/1934] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:02.874212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872211-3edd-480b-ab3e-c67c26daaaef None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.874502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872211-3edd-480b-ab3e-c67c26daaaef None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.874775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872211-3edd-480b-ab3e-c67c26daaaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.901113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01151ab-2990-49cb-8586-6d9f82feb62b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.909556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea74d8-51dc-4f30-98be-b7a96f644f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.910261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-46872211-3edd-480b-ab3e-c67c26daaaef None None] MFA Rules not processed for user `7d01dda5cddf45418dc9bb68e3417860`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.910424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea74d8-51dc-4f30-98be-b7a96f644f6d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.910752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea74d8-51dc-4f30-98be-b7a96f644f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.911073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea74d8-51dc-4f30-98be-b7a96f644f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.911541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-46872211-3edd-480b-ab3e-c67c26daaaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.911867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea74d8-51dc-4f30-98be-b7a96f644f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:02.912181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea74d8-51dc-4f30-98be-b7a96f644f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.913883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea74d8-51dc-4f30-98be-b7a96f644f6d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.929784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 969/1935] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:02.931174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5113aa-2022-44a8-a459-b2985c071b6e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.931498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5113aa-2022-44a8-a459-b2985c071b6e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.931778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5113aa-2022-44a8-a459-b2985c071b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.975903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0d5113aa-2022-44a8-a459-b2985c071b6e None None] MFA Rules not processed for user `3c3c49ed947f4e9b87000fa9f4739a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.987514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0d5113aa-2022-44a8-a459-b2985c071b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:03.004897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 967/1936] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:03.004897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872211-3edd-480b-ab3e-c67c26daaaef None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.013947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872211-3edd-480b-ab3e-c67c26daaaef None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.019789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.020350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.021089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.021089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.021545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:03.021933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.023620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.027977 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.042645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 968/1937] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:03.042645 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.052086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b49a8-20ef-40c6-9432-e2a13e284dcd admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.057625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.058261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.058529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.058806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.059483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.061439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.086433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 970/1938] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:03.087351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5113aa-2022-44a8-a459-b2985c071b6e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.099106 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5113aa-2022-44a8-a459-b2985c071b6e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.104056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.104717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.105001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.105317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.105958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.108063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.193458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.203054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 969/1939] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:03 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:03.204348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.216694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 971/1940] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:03 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:03.217771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.330851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff954a-6f82-4a86-95b6-f8ad153e115f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.337523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.338907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.340650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.340650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.341456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.345520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.356012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac6bcf-0f3d-4f45-b968-dd617b28f0cc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.376238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.376238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.376865 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.377713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.378997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.383202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.599114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 972/1941] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:03 2022] POST /identity/v3/projects => generated 365 bytes in 1378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:04.599114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.631076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 970/1942] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:03 2022] POST /identity/v3/projects => generated 377 bytes in 1427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:04.637301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.736465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.751591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e4bb-5242-43da-b353-7228e0053580 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.760234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.764497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.764497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.765022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0958-3e52-4c66-a495-f244ea764d96 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.765203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.765203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.765801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.767395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.768332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.768600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.768923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.770131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.772280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.907015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 973/1943] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:04 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:04.907015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.907257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 971/1944] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:04 2022] POST /identity/v3/users => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:04.909009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.933157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50bab-de10-44ca-af6a-325eae7532b7 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.934831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6eb3-6c39-4650-8116-63f6d4e3466f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.940638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.942554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.943275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.944528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.945019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.945153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.945481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.945857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.946433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.946940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.948877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.953526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.977909 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.077207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 974/1945] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:04 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:05.077207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.085055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 972/1946] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:04 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:05.086271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.098185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1d0e-d171-4f5d-84cc-ee466f9d67d8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.100391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23039a6-e648-45af-a22e-231f94d7504a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.105430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.118316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.118316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.118581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.118942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.118942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.119069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.119069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.119210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.119288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.119390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.119475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.122667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 975/1947] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.125797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 973/1948] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.125797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.126034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.136571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110027b-ca49-4d87-ad7b-f48d7bcd626a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.141218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.146991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.146991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.146991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.146991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.147525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8329a1b-9c8e-4a27-a76a-a37655988ef3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.147608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.151772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.152811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.153311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.153779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.154850 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.155693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 974/1949] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.156543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.158065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.166737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e784c6-2396-47d4-a576-4678b322e98c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.171514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.180208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.180345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 976/1950] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.180426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.180426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.180426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.180716 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.180785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.186921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf7a6-8536-484a-a9f4-be0bd587a95a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.188610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 975/1951] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.189545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.195725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.196435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.196693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.196968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] PATH_INFO: `/v3/projects/d512d2401c38411cba1bdf0ccdfb5177/users/d74d4e95cc9e4ced94597b9241e53a2d/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.200641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a86c4-88a3-4939-bcbe-cabd3f2afb8b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.206178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.206892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.207356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.207859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.208949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.211941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.217678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d512d2401c38411cba1bdf0ccdfb5177, user_id=d74d4e95cc9e4ced94597b9241e53a2d, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.220835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.225397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 976/1952] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.226108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.236304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c3916-f9b7-4837-a18a-41ae72223068 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.241627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.243806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.243806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.243806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] PATH_INFO: `/v3/projects/b86cd9c1b84947ada4a3f7eb94a6ae83/users/06561966d45a46b588368dc13908b22b/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.260873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86cd9c1b84947ada4a3f7eb94a6ae83, user_id=06561966d45a46b588368dc13908b22b, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.263640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.302545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 977/1953] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:05 2022] PUT /identity/v3/projects/d512d2401c38411cba1bdf0ccdfb5177/users/d74d4e95cc9e4ced94597b9241e53a2d/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:05.303431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.360407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 977/1954] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:05 2022] PUT /identity/v3/projects/b86cd9c1b84947ada4a3f7eb94a6ae83/users/06561966d45a46b588368dc13908b22b/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:05.361608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.388979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa43fc-ad68-41ae-bdc5-6c350d3bef2b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.441385 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199096-7315-4ce4-b2ee-b11f077bab21 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.446605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.447538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.447824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.448106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] PATH_INFO: `/v3/projects/423eb115aee74dee8f3e22f6ce721682/users/bb496b25103b4f5881f084dbd02d5594/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.454382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.455064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.455344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.457244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] PATH_INFO: `/v3/projects/4a386674bde6429abfafb5061e54af83/users/4ea3a3942e884633b35f3d347ae5f4d5/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.468483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=423eb115aee74dee8f3e22f6ce721682, user_id=bb496b25103b4f5881f084dbd02d5594, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.471285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.473467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a386674bde6429abfafb5061e54af83, user_id=4ea3a3942e884633b35f3d347ae5f4d5, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.476255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.553070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 978/1955] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:05 2022] PUT /identity/v3/projects/423eb115aee74dee8f3e22f6ce721682/users/bb496b25103b4f5881f084dbd02d5594/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:05.554420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.580392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 978/1956] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:05 2022] PUT /identity/v3/projects/4a386674bde6429abfafb5061e54af83/users/4ea3a3942e884633b35f3d347ae5f4d5/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:05.582136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.657256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83571b6-e0b1-417e-8bb9-a0f3ea16acaa admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.658779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37f942-a923-4fe5-827f-f2eef0abdc7d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.663619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2f2af-9088-48b6-8351-df9e55f978c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.664253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2f2af-9088-48b6-8351-df9e55f978c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.664417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca061a-7459-4330-b244-ae0a99823793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.664651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2f2af-9088-48b6-8351-df9e55f978c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.664928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2f2af-9088-48b6-8351-df9e55f978c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.665110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca061a-7459-4330-b244-ae0a99823793 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.665421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca061a-7459-4330-b244-ae0a99823793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.665697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2f2af-9088-48b6-8351-df9e55f978c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.665846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca061a-7459-4330-b244-ae0a99823793 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.666339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca061a-7459-4330-b244-ae0a99823793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.667197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2f2af-9088-48b6-8351-df9e55f978c7 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.668457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca061a-7459-4330-b244-ae0a99823793 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.679065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 979/1957] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.679649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 979/1958] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:05.680392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80a13-a361-4ae0-80f0-d5990fba2419 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.680678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80a13-a361-4ae0-80f0-d5990fba2419 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.682087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80a13-a361-4ae0-80f0-d5990fba2419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.682184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee0b5-446a-4d5a-940f-c7e29bd62792 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.682184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee0b5-446a-4d5a-940f-c7e29bd62792 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.682184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee0b5-446a-4d5a-940f-c7e29bd62792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.711979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e2cee0b5-446a-4d5a-940f-c7e29bd62792 None None] MFA Rules not processed for user `4ea3a3942e884633b35f3d347ae5f4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:05.713134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e2cee0b5-446a-4d5a-940f-c7e29bd62792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:05.713583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-39a80a13-a361-4ae0-80f0-d5990fba2419 None None] MFA Rules not processed for user `bb496b25103b4f5881f084dbd02d5594`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:05.714812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-39a80a13-a361-4ae0-80f0-d5990fba2419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:05.790234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 980/1959] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:05.800082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee0b5-446a-4d5a-940f-c7e29bd62792 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.800177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 980/1960] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:05.800177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80a13-a361-4ae0-80f0-d5990fba2419 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.810842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80a13-a361-4ae0-80f0-d5990fba2419 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.816873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.817620 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.817900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.818176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] PATH_INFO: `/v3/projects/b86cd9c1b84947ada4a3f7eb94a6ae83/users/06561966d45a46b588368dc13908b22b/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.818436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee0b5-446a-4d5a-940f-c7e29bd62792 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.820424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86cd9c1b84947ada4a3f7eb94a6ae83, user_id=06561966d45a46b588368dc13908b22b, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.823140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.829792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.832399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.832801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.837391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.837586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] PATH_INFO: `/v3/projects/d512d2401c38411cba1bdf0ccdfb5177/users/d74d4e95cc9e4ced94597b9241e53a2d/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.837586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d512d2401c38411cba1bdf0ccdfb5177, user_id=d74d4e95cc9e4ced94597b9241e53a2d, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.837923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.848161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 981/1961] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:05 2022] PUT /identity/v3/projects/b86cd9c1b84947ada4a3f7eb94a6ae83/users/06561966d45a46b588368dc13908b22b/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:05.849682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.863402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 981/1962] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:05 2022] PUT /identity/v3/projects/d512d2401c38411cba1bdf0ccdfb5177/users/d74d4e95cc9e4ced94597b9241e53a2d/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:05.863402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.863402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:05.863402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.940120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedffe8b-c5d0-4ef6-ab8b-b3f02c16bf97 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.940656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d16e19-d6e2-47bf-9da2-7311c845a558 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.944494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9b97e-8aaa-4e95-abc6-aa0fb3a9999c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.945153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b97e-8aaa-4e95-abc6-aa0fb3a9999c service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.945434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b97e-8aaa-4e95-abc6-aa0fb3a9999c service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.945719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b97e-8aaa-4e95-abc6-aa0fb3a9999c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.023403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874194-0208-4852-8b72-77c704611079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.024465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874194-0208-4852-8b72-77c704611079 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.026766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874194-0208-4852-8b72-77c704611079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.026766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874194-0208-4852-8b72-77c704611079 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.026766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d874194-0208-4852-8b72-77c704611079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.028498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9b97e-8aaa-4e95-abc6-aa0fb3a9999c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.030279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d874194-0208-4852-8b72-77c704611079 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.030453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9b97e-8aaa-4e95-abc6-aa0fb3a9999c service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.041723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 982/1963] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:06.043303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c842-25e1-48ec-8c16-312ca8ff63b4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.043655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c842-25e1-48ec-8c16-312ca8ff63b4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.044007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c842-25e1-48ec-8c16-312ca8ff63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.051308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.093536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ecf0c842-25e1-48ec-8c16-312ca8ff63b4 None None] MFA Rules not processed for user `06561966d45a46b588368dc13908b22b`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:06.094841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ecf0c842-25e1-48ec-8c16-312ca8ff63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.157159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 982/1964] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:05 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:06.157836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef362-4add-44bc-b0ea-61197307d83c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.158187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef362-4add-44bc-b0ea-61197307d83c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.158443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef362-4add-44bc-b0ea-61197307d83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.185886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.209198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 983/1965] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:06.209198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0c842-25e1-48ec-8c16-312ca8ff63b4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.219120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0c842-25e1-48ec-8c16-312ca8ff63b4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.227522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-022ef362-4add-44bc-b0ea-61197307d83c None None] MFA Rules not processed for user `d74d4e95cc9e4ced94597b9241e53a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:06.229119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-022ef362-4add-44bc-b0ea-61197307d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.315678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 983/1966] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:06.315678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef362-4add-44bc-b0ea-61197307d83c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.323183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.324659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.325375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.326160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] PATH_INFO: `/v3/users/4ea3a3942e884633b35f3d347ae5f4d5` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.328665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea3a3942e884633b35f3d347ae5f4d5)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.332658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef362-4add-44bc-b0ea-61197307d83c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.332858 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.341174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.341946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.342311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.343178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.344448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.346276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.473250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 984/1967] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:06 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:06.474154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.476030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.480802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.544153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae01fa-96cf-4754-8e17-00107e056cd4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.547873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.548388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.548663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.548934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.599646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.606364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea3a3942e884633b35f3d347ae5f4d5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:06.607230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea3a3942e884633b35f3d347ae5f4d5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:06.618046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea3a3942e884633b35f3d347ae5f4d5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:06.619131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea3a3942e884633b35f3d347ae5f4d5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:06.625509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.627663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.639948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-f208a3b7-c508-4fca-9872-c2893bc386f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea3a3942e884633b35f3d347ae5f4d5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:06.640369 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 985/1968] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:06.641320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.650776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f80c-8ff4-481b-99eb-fe3716c4bf9b service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.654836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.655493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.655782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.656180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.658289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.672302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.673772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.685576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 986/1969] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:06.686520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.688212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.709111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6009df-89be-4dbd-927f-d9745b6d3e48 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.715753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.716791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.717278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.717788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.718993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.722176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.744547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 987/1970] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:06.747264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.754742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 984/1971] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:06 2022] DELETE /identity/v3/users/4ea3a3942e884633b35f3d347ae5f4d5 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:06.762719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.763195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.763580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.765356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1c62-70c4-4e28-900f-8be532f6aaaa admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.805885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:06.807927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.864955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.866060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.866570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.867035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.868288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.871426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.877994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.885103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 985/1972] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:06.901361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 988/1973] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:06.904789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.904789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.908804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.924665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4c81f-e449-4b4b-aa6a-9a803c44cae5 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.932860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.934181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.934690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.935186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] PATH_INFO: `/v3/projects/1c36bca3983642ceaa05aca626d7e601/users/d21b1fcf5cd24532a4f0779e2554979b/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.964409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c36bca3983642ceaa05aca626d7e601, user_id=d21b1fcf5cd24532a4f0779e2554979b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.970504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.994441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.999627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef38f5b-bd21-4186-97c3-2b26d4aab55e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.003137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.004314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.004593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.004866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.015296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.016819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.028371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 986/1974] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:07.030745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.030745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:07.064901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 989/1975] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:06 2022] PUT /identity/v3/projects/1c36bca3983642ceaa05aca626d7e601/users/d21b1fcf5cd24532a4f0779e2554979b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:07.064901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.071516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:07.125839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd206f2-7b64-4ded-b42b-d113bf5e13ce service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.150811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f06f-5328-493e-8fd0-5982df0768fb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.156750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910df9f-d368-4941-be7d-01bb4617b4d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.156750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910df9f-d368-4941-be7d-01bb4617b4d9 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.156750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910df9f-d368-4941-be7d-01bb4617b4d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.156750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910df9f-d368-4941-be7d-01bb4617b4d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.158708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6910df9f-d368-4941-be7d-01bb4617b4d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:07.200441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.201420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.201885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.202580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.206156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:07.268948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910df9f-d368-4941-be7d-01bb4617b4d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.272322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910df9f-d368-4941-be7d-01bb4617b4d9 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.288803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 990/1976] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:07.291952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130311-48f8-46f3-87df-19ef3b38cc6f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.292425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130311-48f8-46f3-87df-19ef3b38cc6f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.292877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130311-48f8-46f3-87df-19ef3b38cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.339377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.341301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.354424 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-68130311-48f8-46f3-87df-19ef3b38cc6f None None] MFA Rules not processed for user `d21b1fcf5cd24532a4f0779e2554979b`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:07.356603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-68130311-48f8-46f3-87df-19ef3b38cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:07.366529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 987/1977] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:07.370271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:07.555422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 991/1978] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:07.562215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.582749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:07.707679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322593ca-7503-43bf-a7cc-256a872fd034 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.719115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.720238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.720672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.721098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.721966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.725471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.921946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 988/1979] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:07 2022] POST /identity/v3/projects => generated 379 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:07.923232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130311-48f8-46f3-87df-19ef3b38cc6f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.942017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130311-48f8-46f3-87df-19ef3b38cc6f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.965779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.968992 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.096517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.098018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.098398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.098815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.099635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:08.102043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:08.108354 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff42087-fd5a-4340-995b-fca29fa59f3d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.114483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.118026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.118026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.118026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] PATH_INFO: `/v3/projects/4a386674bde6429abfafb5061e54af83` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.118026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a386674bde6429abfafb5061e54af83)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:08.119766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:08.239894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 992/1980] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:07 2022] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:08.241258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:08.243518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.252912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:08.259838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25343-f499-44fb-bdf5-d4b0a65042bc admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.268076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.269585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.270041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.270898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] PATH_INFO: `/v3/users/7d01dda5cddf45418dc9bb68e3417860` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.273285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d01dda5cddf45418dc9bb68e3417860)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:08.276857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:08.298673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:08.307760 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a386674bde6429abfafb5061e54af83', 'request_id': 'req-c1ada1cd-9d54-4020-ac1b-f387054485e3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.315284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a386674bde6429abfafb5061e54af83', 'request_id': 'req-c1ada1cd-9d54-4020-ac1b-f387054485e3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.410788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a386674bde6429abfafb5061e54af83', 'request_id': 'req-c1ada1cd-9d54-4020-ac1b-f387054485e3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.432225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] The token cache is being invalidate because project 4a386674bde6429abfafb5061e54af83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:08.432847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.434708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.442571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 989/1981] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:07 2022] DELETE /identity/v3/projects/4a386674bde6429abfafb5061e54af83 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:08.442571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:08.442571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.527804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d01dda5cddf45418dc9bb68e3417860'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.563206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d01dda5cddf45418dc9bb68e3417860'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.564913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d01dda5cddf45418dc9bb68e3417860'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.586003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d01dda5cddf45418dc9bb68e3417860'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.589933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada1cd-9d54-4020-ac1b-f387054485e3 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.595746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a8aa-f8ac-4989-8746-512576bddb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.596618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a8aa-f8ac-4989-8746-512576bddb58 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.596986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a8aa-f8ac-4989-8746-512576bddb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.597412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a8aa-f8ac-4989-8746-512576bddb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.598175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a8aa-f8ac-4989-8746-512576bddb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:08.600111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a8aa-f8ac-4989-8746-512576bddb58 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:08.611815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 990/1982] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:08.613323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fae71-ea0c-4ca8-b1b5-086e7d876249 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.613726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fae71-ea0c-4ca8-b1b5-086e7d876249 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.614089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fae71-ea0c-4ca8-b1b5-086e7d876249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.634822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a74fae71-ea0c-4ca8-b1b5-086e7d876249 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:08.636755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a74fae71-ea0c-4ca8-b1b5-086e7d876249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.647376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 991/1983] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:08.648222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fae71-ea0c-4ca8-b1b5-086e7d876249 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:08.658361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fae71-ea0c-4ca8-b1b5-086e7d876249 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.663751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.664607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.665099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.665474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] PATH_INFO: `/v3/projects/cdb3db48d8d64e689e1d89dcb6e49f3b/users/f6073679fa1f4d4cbd42a2088fc11e52/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.672208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-134a54a6-13e2-4bf2-ae72-8e82363c9e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d01dda5cddf45418dc9bb68e3417860'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:08.680624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 993/1984] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:08 2022] DELETE /identity/v3/users/7d01dda5cddf45418dc9bb68e3417860 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:08.682113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da010a-84fe-4794-9a90-bf4dc4a844ea None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.682560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da010a-84fe-4794-9a90-bf4dc4a844ea None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.682775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da010a-84fe-4794-9a90-bf4dc4a844ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.692936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb3db48d8d64e689e1d89dcb6e49f3b, user_id=f6073679fa1f4d4cbd42a2088fc11e52, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:08.696022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:08.704862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b8da010a-84fe-4794-9a90-bf4dc4a844ea None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:08.706099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b8da010a-84fe-4794-9a90-bf4dc4a844ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.776319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 994/1985] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:08.778122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3507c-3ce1-4408-9130-b42c52b5fad9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.778622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3507c-3ce1-4408-9130-b42c52b5fad9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.779099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3507c-3ce1-4408-9130-b42c52b5fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.805127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0dd3507c-3ce1-4408-9130-b42c52b5fad9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:08.808432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0dd3507c-3ce1-4408-9130-b42c52b5fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.819703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 995/1986] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:08.824782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3507c-3ce1-4408-9130-b42c52b5fad9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:08.839116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3507c-3ce1-4408-9130-b42c52b5fad9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.839802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 992/1987] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:08 2022] PUT /identity/v3/projects/cdb3db48d8d64e689e1d89dcb6e49f3b/users/f6073679fa1f4d4cbd42a2088fc11e52/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:08.841290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:08.845079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.984204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec767ca-336d-42e1-a779-84e698cfb58d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.993600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.994976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.995678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.996467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.006210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.006968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.007425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.007870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.008986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:09.009498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.012340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.025265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.030165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.050643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 996/1988] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:09.052159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.055817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:09.058507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 993/1989] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:09.072621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.095277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.105277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a0c46-4564-4598-b9ba-51cb66b9e0f1 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.112442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc353e3d-852e-46bb-bc70-8fd061e4b9c6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.112869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.114020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.114482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.114932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.116017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.116209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.117124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.117662 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.118169 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.119557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.119727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.122671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.144933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 997/1990] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:09.152410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.175511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b4c8-3596-4518-92de-d7c7f28df36d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.177577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fafa4-9385-4111-81f0-ad5cad880851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.178630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fafa4-9385-4111-81f0-ad5cad880851 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.179175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fafa4-9385-4111-81f0-ad5cad880851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.179918 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fafa4-9385-4111-81f0-ad5cad880851 admin admin] PATH_INFO: `/v3/projects/cdb3db48d8d64e689e1d89dcb6e49f3b/users/f6073679fa1f4d4cbd42a2088fc11e52/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.183130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fafa4-9385-4111-81f0-ad5cad880851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb3db48d8d64e689e1d89dcb6e49f3b, user_id=f6073679fa1f4d4cbd42a2088fc11e52, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.186896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fafa4-9385-4111-81f0-ad5cad880851 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.203342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 998/1991] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:09 2022] PUT /identity/v3/projects/cdb3db48d8d64e689e1d89dcb6e49f3b/users/f6073679fa1f4d4cbd42a2088fc11e52/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:09.215841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.216158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.216399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.254216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] MFA Rules not processed for user `f6073679fa1f4d4cbd42a2088fc11e52`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:09.256455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:09.341021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 994/1992] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:09 2022] POST /identity/v3/projects => generated 377 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:09.342269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.373670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 999/1993] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:09.377209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.386044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.387570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:09.459013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734f7f0-6f3f-49d9-bb12-7a7940a65849 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.465743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.469442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.469442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.469442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.469442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.470128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.491374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32f09-a19d-4952-874c-d6deaf553482 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.574369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 995/1994] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:09 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:09.581715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.607036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea246e-be3e-4d03-a0f9-c79e3a7748e3 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.617817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.619063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.619395 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.620811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.623893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.626108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.637497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.639091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.639883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.640724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.658995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 996/1995] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:09.669300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.703412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02148583-ee4e-4e56-a067-e9a382f2273b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.715281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.716474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.717031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.717592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.718866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.720457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.726483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.746424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 997/1996] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:09.751126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.768426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e382e-6d6a-4538-b3f6-777209bb8c89 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.775881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.776321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.777282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.777809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.778258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] PATH_INFO: `/v3/projects/d4646d0a39294d41903c42443888bd32/users/e2e1d5acbe554e64b8a716f8241e427a/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.778523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.812013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1000/1997] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:09.820337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.825200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:09.827474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4646d0a39294d41903c42443888bd32, user_id=e2e1d5acbe554e64b8a716f8241e427a, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.832874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.854037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e754f-dd07-4a49-835e-177cb0de2819 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.863990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.865112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.865619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.866140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] PATH_INFO: `/v3/projects/9df574cd0d674f6c92c071d674505e98` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.868680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df574cd0d674f6c92c071d674505e98)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.872735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.989039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 998/1998] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:09 2022] PUT /identity/v3/projects/d4646d0a39294d41903c42443888bd32/users/e2e1d5acbe554e64b8a716f8241e427a/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:09.989937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.991811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:10.053042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df574cd0d674f6c92c071d674505e98', 'request_id': 'req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.063187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df574cd0d674f6c92c071d674505e98', 'request_id': 'req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.073569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b725-d605-4243-b559-4d4f2ed2bc43 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.140693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.142272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.142272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.142272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.148291 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:10.157700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df574cd0d674f6c92c071d674505e98', 'request_id': 'req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.173417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] The token cache is being invalidate because project 9df574cd0d674f6c92c071d674505e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:10.174122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.174991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ba2da7e4-25cb-44a7-8278-891a09d0cf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.178125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1001/1999] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:09 2022] DELETE /identity/v3/projects/9df574cd0d674f6c92c071d674505e98 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:10.179922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.180354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.180739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.224519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] MFA Rules not processed for user `e2e1d5acbe554e64b8a716f8241e427a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:10.226469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:10.240278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.279975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.281692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.307194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 999/2000] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:10.312130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.434013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1002/2001] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:10.434134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692700d-8b0d-44fe-9089-9938bf5f3e07 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.438671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.440381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:10.440517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.441960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.442310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.442753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] PATH_INFO: `/v3/users/d74d4e95cc9e4ced94597b9241e53a2d` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.444265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74d4e95cc9e4ced94597b9241e53a2d)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.446766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.455497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8921812-2939-490f-bb14-617c4e93d0a6 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.461251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.461879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.462160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.462486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.463426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.465128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.640508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1003/2002] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:10 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:10.646611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.704440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.774125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c67b8-f7e9-46c2-8d82-2db459cf7351 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.779755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.780379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.780650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.780925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.781652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.783728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.798146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74d4e95cc9e4ced94597b9241e53a2d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.798819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74d4e95cc9e4ced94597b9241e53a2d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.806741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74d4e95cc9e4ced94597b9241e53a2d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.807445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74d4e95cc9e4ced94597b9241e53a2d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.820099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74d4e95cc9e4ced94597b9241e53a2d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:10.983079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1000/2003] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:10 2022] DELETE /identity/v3/users/d74d4e95cc9e4ced94597b9241e53a2d => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:11.094114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1004/2004] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:10 2022] POST /identity/v3/users => generated 289 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:11.103463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.107177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:11.242919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:11.296544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4802-fede-4c6f-9520-138cd6edb0ac admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.309693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.310778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.311290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.311831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.313147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.317147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.338347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1001/2005] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:11.344028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.357829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f491b-58c6-4634-935a-bb1def5851ce admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.365441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd17ed-e01d-4743-b275-439e4546e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.366266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd17ed-e01d-4743-b275-439e4546e250 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.366746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd17ed-e01d-4743-b275-439e4546e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.367144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd17ed-e01d-4743-b275-439e4546e250 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.368211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd17ed-e01d-4743-b275-439e4546e250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.370495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd17ed-e01d-4743-b275-439e4546e250 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.387793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1005/2006] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:11.394441 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.405466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bd662-cb01-419a-b15f-065439a7dcba admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.412718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c4a2-8252-4256-8131-784ae5dad180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.413847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c4a2-8252-4256-8131-784ae5dad180 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.414301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c4a2-8252-4256-8131-784ae5dad180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.414801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c4a2-8252-4256-8131-784ae5dad180 admin admin] PATH_INFO: `/v3/projects/a992b2e11d844736b45277b2a5a66133/users/c2c34b0525f040c3b3d43fdb1dec2b55/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.449905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8c4a2-8252-4256-8131-784ae5dad180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a992b2e11d844736b45277b2a5a66133, user_id=c2c34b0525f040c3b3d43fdb1dec2b55, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.455594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8c4a2-8252-4256-8131-784ae5dad180 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.647730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1002/2007] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:11 2022] PUT /identity/v3/projects/a992b2e11d844736b45277b2a5a66133/users/c2c34b0525f040c3b3d43fdb1dec2b55/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:11.661874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9492-34e9-4130-a88b-20c9336f4782 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.662672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9492-34e9-4130-a88b-20c9336f4782 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.663149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9492-34e9-4130-a88b-20c9336f4782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.726286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d503e0-0eee-432b-93af-41bcc72de3ec None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.726946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d503e0-0eee-432b-93af-41bcc72de3ec None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.727593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d503e0-0eee-432b-93af-41bcc72de3ec None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.744082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1003/2008] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:54:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:11.745906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.746401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.746847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.808761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:11.811220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:11.823083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-65ed9492-34e9-4130-a88b-20c9336f4782 None None] MFA Rules not processed for user `c2c34b0525f040c3b3d43fdb1dec2b55`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:11.828431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-65ed9492-34e9-4130-a88b-20c9336f4782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.052351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1004/2009] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:54:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:12.070011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1006/2010] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:12.074881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.075436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9492-34e9-4130-a88b-20c9336f4782 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.076750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.099390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb726ed-573a-4458-8d87-cbb77792e020 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.108639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.125143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.125143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.125143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.125143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.128059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.144706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1005/2011] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:12.181382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9492-34e9-4130-a88b-20c9336f4782 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.183411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.185580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.196595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.197261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.197593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.198340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.199264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.203434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.250731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd120e31-446a-453c-b8f7-4dae3117070b service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.265566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.266537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.266972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.267459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] PATH_INFO: `/v3/projects/d512d2401c38411cba1bdf0ccdfb5177` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.269722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d512d2401c38411cba1bdf0ccdfb5177)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.273097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.333899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1007/2012] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:12 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:12.335585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.395879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:12.433522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd512d2401c38411cba1bdf0ccdfb5177', 'request_id': 'req-99e2a880-a1f1-4178-a767-1e053d04c45c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:12.445900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd512d2401c38411cba1bdf0ccdfb5177', 'request_id': 'req-99e2a880-a1f1-4178-a767-1e053d04c45c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:12.468483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab025f-f8c9-4f3b-a670-df993c58a605 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.513554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd512d2401c38411cba1bdf0ccdfb5177', 'request_id': 'req-99e2a880-a1f1-4178-a767-1e053d04c45c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:12.539976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] The token cache is being invalidate because project d512d2401c38411cba1bdf0ccdfb5177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:12.540677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:12.541562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99e2a880-a1f1-4178-a767-1e053d04c45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:12.552109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1006/2013] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:12 2022] DELETE /identity/v3/projects/d512d2401c38411cba1bdf0ccdfb5177 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:12.553177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.553809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.554136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.555184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6df6d-bcaf-4411-bb0e-bbce876a2404 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.555340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.555635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6df6d-bcaf-4411-bb0e-bbce876a2404 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.555820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.555972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6df6d-bcaf-4411-bb0e-bbce876a2404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.557180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.581116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-89d6df6d-bcaf-4411-bb0e-bbce876a2404 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:12.582595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-89d6df6d-bcaf-4411-bb0e-bbce876a2404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.591712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1007/2014] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:12.599748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c87f5-1b7f-463b-82ac-cde29a27e364 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.600064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c87f5-1b7f-463b-82ac-cde29a27e364 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.600308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c87f5-1b7f-463b-82ac-cde29a27e364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.621349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-258c87f5-1b7f-463b-82ac-cde29a27e364 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:12.622677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-258c87f5-1b7f-463b-82ac-cde29a27e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.631882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1008/2015] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:12.636589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c87f5-1b7f-463b-82ac-cde29a27e364 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.647202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c87f5-1b7f-463b-82ac-cde29a27e364 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.652617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.653240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.653522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.653799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.654457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:12.654849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.656519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.659374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:12.669818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1009/2016] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:12.674648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.688392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd226a-6df9-43b7-ac8a-b19f1936c0f2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.696616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.697390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.697721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.698186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.709525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.709525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.710841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1008/2017] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:12 2022] POST /identity/v3/users => generated 295 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:12.717402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.721593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:12.749563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae6e62-2aa8-4c79-9f86-3e8acca6171c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.758256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.759540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.759838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.760275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.761453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.763614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.782152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1009/2018] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:12.792529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.808557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaa595-d403-46e4-9829-d28e615a846f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.830576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1010/2019] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:12 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:12.832781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.841986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.843172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.847168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.847168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] PATH_INFO: `/v3/projects/4e2559acd50345619f3777acaec78962/users/7679de82911d45bbb047c1e27e20974a/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.875302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2559acd50345619f3777acaec78962, user_id=7679de82911d45bbb047c1e27e20974a, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.881924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.955115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de6543-386c-4d63-9537-ee247f8adf6b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.963071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.964154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.964701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.965232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.966386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.970257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.980619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1010/2020] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:12 2022] PUT /identity/v3/projects/4e2559acd50345619f3777acaec78962/users/7679de82911d45bbb047c1e27e20974a/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:12.990411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:13.107860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1011/2021] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:12 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:13.110170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:13.143167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb51222-7067-4331-9dda-94c8aa0a9b30 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:13.171687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3762-2a52-4c45-9fe1-0cb8b6f33aa2 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:13.182332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:13.183334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.183836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.184445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.185584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:13.188548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:13.219856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1011/2022] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:13.222913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:13.278318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76626700-cb3b-4e49-ac52-976dd1b8a9b4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:13.289001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:13.290285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.291228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.293174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] PATH_INFO: `/v3/projects/4e2559acd50345619f3777acaec78962/users/7679de82911d45bbb047c1e27e20974a/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.296690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2559acd50345619f3777acaec78962, user_id=7679de82911d45bbb047c1e27e20974a, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:13.300794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be66af0-356e-4633-8861-f1a51eb1fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:13.302951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:13.304845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66af0-356e-4633-8861-f1a51eb1fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.309621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66af0-356e-4633-8861-f1a51eb1fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.310234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66af0-356e-4633-8861-f1a51eb1fea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.315171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be66af0-356e-4633-8861-f1a51eb1fea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:13.318269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be66af0-356e-4633-8861-f1a51eb1fea4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:13.323288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:13.335410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1012/2023] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:13 2022] PUT /identity/v3/projects/4e2559acd50345619f3777acaec78962/users/7679de82911d45bbb047c1e27e20974a/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:13.346919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1012/2024] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:13.367680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:13.373698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.373698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.373698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.462672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] MFA Rules not processed for user `7679de82911d45bbb047c1e27e20974a`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:13.476512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:13.582575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79906d8-2414-4e51-99f3-10459efea3fd admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:13.592720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:13.594227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.595645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.596284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.598949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:13.602386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:13.633104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1013/2025] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:13.635665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:13.649543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:13.658211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3965b9-fc90-4198-a61b-3dd92ab1b03d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:13.668579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724c3b4-baa1-4ddd-b3cf-7c994ac062e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:13.669897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c3b4-baa1-4ddd-b3cf-7c994ac062e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.670652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c3b4-baa1-4ddd-b3cf-7c994ac062e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.671231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c3b4-baa1-4ddd-b3cf-7c994ac062e5 admin admin] PATH_INFO: `/v3/projects/ec1c313ab77348b19aa46f161030a2e6/users/9d08758b38274e30811b86917815539f/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.696797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1013/2026] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:13.728622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724c3b4-baa1-4ddd-b3cf-7c994ac062e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1c313ab77348b19aa46f161030a2e6, user_id=9d08758b38274e30811b86917815539f, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:13.735193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724c3b4-baa1-4ddd-b3cf-7c994ac062e5 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:13.751432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:13.755270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:13.888765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1014/2027] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:13 2022] PUT /identity/v3/projects/ec1c313ab77348b19aa46f161030a2e6/users/9d08758b38274e30811b86917815539f/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:13.895995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.896858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.897749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.929955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753de9f-1845-4603-a58b-1b913f0763a2 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:13.950501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:13.955016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.061600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcf428-f8cb-4979-952c-3d826cb7c695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:14.063616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf428-f8cb-4979-952c-3d826cb7c695 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.066554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf428-f8cb-4979-952c-3d826cb7c695 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.067251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf428-f8cb-4979-952c-3d826cb7c695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.072352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-57bcf428-f8cb-4979-952c-3d826cb7c695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.161348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1015/2028] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:14.179163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:14.182698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.402018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf428-f8cb-4979-952c-3d826cb7c695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:14.409534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf428-f8cb-4979-952c-3d826cb7c695 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:14.461981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794172fc-4046-4e4a-864d-dc91cd97cb9d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:14.490556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:14.491698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.498072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.501683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.534820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1014/2029] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:14.558546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:14.564770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:14.588740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1016/2030] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:17.375830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631043ac-3cf5-4e15-9253-ea1bbaf8075d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.376592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631043ac-3cf5-4e15-9253-ea1bbaf8075d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.376984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631043ac-3cf5-4e15-9253-ea1bbaf8075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.432975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-631043ac-3cf5-4e15-9253-ea1bbaf8075d None None] MFA Rules not processed for user `9d08758b38274e30811b86917815539f`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:17.435466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-631043ac-3cf5-4e15-9253-ea1bbaf8075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:17.516450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:17.543816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1015/2031] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:17.549621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.563402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d79a-1f5e-49e1-928d-27902db9e152 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.569135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.569911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.570372 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.570735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.571603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.574240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.593265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:17.673748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1017/2032] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:17 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:17.684374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631043ac-3cf5-4e15-9253-ea1bbaf8075d None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.696593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631043ac-3cf5-4e15-9253-ea1bbaf8075d None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.763216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.764068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.764548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.764965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.766166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.769649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.927800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1016/2033] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:17 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:17.932476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.952724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4f230-bf85-4084-844a-e2817089e873 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.958690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.959672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.960123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.960597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.961600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.963618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.983425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1018/2034] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:17.986491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.998055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a382-c5aa-46a2-b38f-e2f662e8df13 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.003722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.004598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.004888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.005165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] PATH_INFO: `/v3/projects/b7dd6fbd66534a85b0199acf299bf847/users/b31637cf38484758985e9f148c3eddbb/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.024232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dd6fbd66534a85b0199acf299bf847, user_id=b31637cf38484758985e9f148c3eddbb, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.026943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.155585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1017/2035] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:17 2022] PUT /identity/v3/projects/b7dd6fbd66534a85b0199acf299bf847/users/b31637cf38484758985e9f148c3eddbb/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:18.160188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.171271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8579b-a7de-47f0-9167-5b2163d9b422 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.254619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47acf1b-9a12-4b44-8a8e-c9d6c5babaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.255260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47acf1b-9a12-4b44-8a8e-c9d6c5babaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.255581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47acf1b-9a12-4b44-8a8e-c9d6c5babaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.255860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47acf1b-9a12-4b44-8a8e-c9d6c5babaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.256530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47acf1b-9a12-4b44-8a8e-c9d6c5babaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.258182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47acf1b-9a12-4b44-8a8e-c9d6c5babaf4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.269961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1019/2036] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:18.274501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.286258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8c3f-0cad-46e3-b9f4-a8fa356d6cbc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.292184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.292874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.293153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.293427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] PATH_INFO: `/v3/projects/b7dd6fbd66534a85b0199acf299bf847/users/b31637cf38484758985e9f148c3eddbb/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.295530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dd6fbd66534a85b0199acf299bf847, user_id=b31637cf38484758985e9f148c3eddbb, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.298247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.310156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1018/2037] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:18 2022] PUT /identity/v3/projects/b7dd6fbd66534a85b0199acf299bf847/users/b31637cf38484758985e9f148c3eddbb/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:20.046785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.047663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.048325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.117298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] MFA Rules not processed for user `b31637cf38484758985e9f148c3eddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:20.119971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:20.315482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1020/2038] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:20.330138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:20.449882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940823d-9af9-462f-a9a6-ef1084c95b95 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:20.456882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:20.457911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.458375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.458780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.528648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:20.545002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:20.550054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:20.563972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1019/2039] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:22.673683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.676696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:22.697054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.698516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:22.838688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1f91-3958-401c-9de5-3f769f947850 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.841323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5acc8d-34f3-4119-87c3-08032dc5d3dd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.849998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.851101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.851787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.852113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] PATH_INFO: `/v3/users/bb496b25103b4f5881f084dbd02d5594` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.853652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb496b25103b4f5881f084dbd02d5594)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.855807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.857109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.860529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.861019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.861711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] PATH_INFO: `/v3/users/3c3c49ed947f4e9b87000fa9f4739a7b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.865056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3c49ed947f4e9b87000fa9f4739a7b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.867152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.881714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.122908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3c49ed947f4e9b87000fa9f4739a7b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.137131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3c49ed947f4e9b87000fa9f4739a7b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.137263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3c49ed947f4e9b87000fa9f4739a7b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.145324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb496b25103b4f5881f084dbd02d5594'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.146222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb496b25103b4f5881f084dbd02d5594'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.164761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb496b25103b4f5881f084dbd02d5594'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.166070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb496b25103b4f5881f084dbd02d5594'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.180583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3c49ed947f4e9b87000fa9f4739a7b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.189477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-16d20fd5-b4cf-41d9-b2fc-fcb0d0cae790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb496b25103b4f5881f084dbd02d5594'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.328967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3c49ed947f4e9b87000fa9f4739a7b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:23.336904 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1021/2040] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:22 2022] DELETE /identity/v3/users/3c3c49ed947f4e9b87000fa9f4739a7b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:23.340934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.342434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.421680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1020/2041] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:22 2022] DELETE /identity/v3/users/bb496b25103b4f5881f084dbd02d5594 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:23.427107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720123-7120-4feb-b4e7-9f14ad10eabd None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.427488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720123-7120-4feb-b4e7-9f14ad10eabd None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.427738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720123-7120-4feb-b4e7-9f14ad10eabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.445730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97aa50-b2e0-43a9-8b81-66b8deda19dc admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.450041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-dc720123-7120-4feb-b4e7-9f14ad10eabd None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:23.451451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dc720123-7120-4feb-b4e7-9f14ad10eabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.535200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.536727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.537200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.537918 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.542648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.561355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1021/2042] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:23.568557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.568851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.569126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.590114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:23.591766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.605366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1022/2043] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:23.605366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.605366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.613339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.663979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.672743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.677558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.691042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1022/2044] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:23.692404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.699459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8639eb-dd26-4034-8106-e2044f82b70a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.704636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938222ac-f447-453e-bd46-ef138c9f5e37 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.710144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.710144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.710144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.710144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.710473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.710473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.710473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.710473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.722932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.724986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.725848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.728476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.738188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1023/2045] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:23.751266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1023/2046] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:23.788254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.789829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.804495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c03aeb-3755-476e-aa87-74f016778aa0 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.809012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.809727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.810016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.810291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.812259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.938830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.940940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.953373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1024/2047] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:24.637263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.639651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:24.678960 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0bca-5599-4062-a167-db497ab6ee7a service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.698505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.700061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.700938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.702211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] PATH_INFO: `/v3/projects/423eb115aee74dee8f3e22f6ce721682` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.704014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=423eb115aee74dee8f3e22f6ce721682)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.707197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.820929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.822888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:24.853034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aef19-6dfb-4aea-a963-8eb169d04a87 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.872173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423eb115aee74dee8f3e22f6ce721682', 'request_id': 'req-2f046814-d21c-4f62-98b4-c008a08a0763'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:24.880471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423eb115aee74dee8f3e22f6ce721682', 'request_id': 'req-2f046814-d21c-4f62-98b4-c008a08a0763'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:24.953653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423eb115aee74dee8f3e22f6ce721682', 'request_id': 'req-2f046814-d21c-4f62-98b4-c008a08a0763'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:24.965433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.966775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.967260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.967800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] PATH_INFO: `/v3/projects/7fee27962fb841169760815f4535a28b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.968069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] The token cache is being invalidate because project 423eb115aee74dee8f3e22f6ce721682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:24.968371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:24.969079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:24.969912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fee27962fb841169760815f4535a28b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.970682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1024/2048] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:24 2022] DELETE /identity/v3/projects/423eb115aee74dee8f3e22f6ce721682 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:24.973167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.976941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.979270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:25.001991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f046814-d21c-4f62-98b4-c008a08a0763 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:25.010610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:25.011722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:25.012201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:25.012671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] PATH_INFO: `/v3/users/d21b1fcf5cd24532a4f0779e2554979b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:25.014658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21b1fcf5cd24532a4f0779e2554979b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:25.018705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:25.097136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fee27962fb841169760815f4535a28b', 'request_id': 'req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.102664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fee27962fb841169760815f4535a28b', 'request_id': 'req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.180933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fee27962fb841169760815f4535a28b', 'request_id': 'req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.193534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] The token cache is being invalidate because project 7fee27962fb841169760815f4535a28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:25.193817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.194472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.196874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1025/2049] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:24 2022] DELETE /identity/v3/projects/7fee27962fb841169760815f4535a28b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:25.200596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:25.202956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:25.209283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:25.252909 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21b1fcf5cd24532a4f0779e2554979b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.253622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21b1fcf5cd24532a4f0779e2554979b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.265206 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21b1fcf5cd24532a4f0779e2554979b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.266190 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21b1fcf5cd24532a4f0779e2554979b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.287846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8e52a-807e-42eb-9b39-14c8ecdb89b2 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:25.291590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21b1fcf5cd24532a4f0779e2554979b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.293306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:25.293958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:25.294242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:25.294527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] PATH_INFO: `/v3/users/06561966d45a46b588368dc13908b22b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:25.295780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06561966d45a46b588368dc13908b22b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:25.297753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:25.390238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1025/2050] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:24 2022] DELETE /identity/v3/users/d21b1fcf5cd24532a4f0779e2554979b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:25.504404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06561966d45a46b588368dc13908b22b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.512374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06561966d45a46b588368dc13908b22b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.513666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06561966d45a46b588368dc13908b22b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.528533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06561966d45a46b588368dc13908b22b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.604823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06561966d45a46b588368dc13908b22b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:25.617405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1026/2051] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:25 2022] DELETE /identity/v3/users/06561966d45a46b588368dc13908b22b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:26.040325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.042562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.050007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:26.171347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920aeba-6f58-447d-a8be-ce061a09383a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:26.256391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:26.257045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.257322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.257592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] PATH_INFO: `/v3/projects/1c36bca3983642ceaa05aca626d7e601` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.258771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c36bca3983642ceaa05aca626d7e601)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:26.260761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:26.360142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.362419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.380398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6215-441a-4899-9937-da57babab506 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:26.388722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:26.389707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.390211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.390694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] PATH_INFO: `/v3/projects/b86cd9c1b84947ada4a3f7eb94a6ae83` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.392244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86cd9c1b84947ada4a3f7eb94a6ae83)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:26.394931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:26.414206 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c36bca3983642ceaa05aca626d7e601', 'request_id': 'req-dcd6cd9c-7615-4b21-af1d-7748800923f5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.433639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c36bca3983642ceaa05aca626d7e601', 'request_id': 'req-dcd6cd9c-7615-4b21-af1d-7748800923f5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.545132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86cd9c1b84947ada4a3f7eb94a6ae83', 'request_id': 'req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.552027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c36bca3983642ceaa05aca626d7e601', 'request_id': 'req-dcd6cd9c-7615-4b21-af1d-7748800923f5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.553002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86cd9c1b84947ada4a3f7eb94a6ae83', 'request_id': 'req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.568457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] The token cache is being invalidate because project 1c36bca3983642ceaa05aca626d7e601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:26.568793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.569456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.571052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1026/2052] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:26 2022] DELETE /identity/v3/projects/1c36bca3983642ceaa05aca626d7e601 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:26.575978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.577450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.650966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:26.654404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86cd9c1b84947ada4a3f7eb94a6ae83', 'request_id': 'req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.669785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] The token cache is being invalidate because project b86cd9c1b84947ada4a3f7eb94a6ae83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:26.670105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.670801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6f6b13d0-fcdd-4a3f-b387-0ea5a0fe9ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:26.672752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1027/2053] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:26 2022] DELETE /identity/v3/projects/b86cd9c1b84947ada4a3f7eb94a6ae83 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:26.679840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711862-7b5f-4902-9265-cb176432300c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.680311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711862-7b5f-4902-9265-cb176432300c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.680764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711862-7b5f-4902-9265-cb176432300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.687324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6cd9c-7615-4b21-af1d-7748800923f5 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:26.707262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:26.714034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-af711862-7b5f-4902-9265-cb176432300c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:26.718596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-af711862-7b5f-4902-9265-cb176432300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.766874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:26.767871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.768695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.768967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] PATH_INFO: `/v3/users/f6073679fa1f4d4cbd42a2088fc11e52` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.770182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6073679fa1f4d4cbd42a2088fc11e52)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:26.772220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:26.825492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1028/2054] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:26.838238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8de9-6f6c-4b49-9560-edb059feb8bc None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.838649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8de9-6f6c-4b49-9560-edb059feb8bc None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.839034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8de9-6f6c-4b49-9560-edb059feb8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.867331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-99cc8de9-6f6c-4b49-9560-edb059feb8bc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:26.868600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-99cc8de9-6f6c-4b49-9560-edb059feb8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.881983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1029/2055] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:26.886025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc8de9-6f6c-4b49-9560-edb059feb8bc None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.915750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc8de9-6f6c-4b49-9560-edb059feb8bc None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:26.915750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:26.915750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.915750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.916094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.916094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:26.916094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:26.916732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:26.945435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1030/2056] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:26.952925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.964944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b43e1-322c-4c9a-82e4-35230a9435c3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:26.973595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:26.978271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.978271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.978271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.978271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:26.980704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.083079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6073679fa1f4d4cbd42a2088fc11e52'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:27.084191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6073679fa1f4d4cbd42a2088fc11e52'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:27.092458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1031/2057] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:26 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:27.115619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.115619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:27.115844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6073679fa1f4d4cbd42a2088fc11e52'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:27.115844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6073679fa1f4d4cbd42a2088fc11e52'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:27.133028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6073679fa1f4d4cbd42a2088fc11e52'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:27.215882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1027/2058] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:26 2022] DELETE /identity/v3/users/f6073679fa1f4d4cbd42a2088fc11e52 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:27.234014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3acf8-52dc-4ae1-bb95-932b213a23c8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.344115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.345043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.345517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.345769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.346919 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.349232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.502250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1032/2059] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:27 2022] POST /identity/v3/users => generated 289 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:27.507316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.519251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf873cd-934a-407b-b179-4ff404d204eb admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.524700 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.525345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.525620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.526730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.526730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.528285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.544549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1028/2060] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:27.551103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.560045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.569483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa9ff0-ada5-46bb-8245-db89ae86aef9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.577400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ea205-7713-4003-ad11-4cf52e1fb625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.578546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ea205-7713-4003-ad11-4cf52e1fb625 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.579063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ea205-7713-4003-ad11-4cf52e1fb625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.579743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ea205-7713-4003-ad11-4cf52e1fb625 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.581498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ea205-7713-4003-ad11-4cf52e1fb625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.584701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ea205-7713-4003-ad11-4cf52e1fb625 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.606589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1033/2061] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:27.609704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.620570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44523e-1e88-419c-8ef0-77dbe877f615 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.630850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.636151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.636151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.636151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] PATH_INFO: `/v3/projects/2ae74e9600924c19aafb361e85636135/users/c453403ed2ea417db3c8697450cd1b78/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.655577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae74e9600924c19aafb361e85636135, user_id=c453403ed2ea417db3c8697450cd1b78, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.658311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.776833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1029/2062] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:27 2022] PUT /identity/v3/projects/2ae74e9600924c19aafb361e85636135/users/c453403ed2ea417db3c8697450cd1b78/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:27.787939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.788226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.788508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.807431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.823118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:27.828409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] MFA Rules not processed for user `c453403ed2ea417db3c8697450cd1b78`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:27.831590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:27.886311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.911315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1034/2063] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:27.921751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910a6c-8752-4dc7-b184-6839d6bbe584 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.923619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.925091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:27.927015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.927713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.927999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.929199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] PATH_INFO: `/v3/projects/cdb3db48d8d64e689e1d89dcb6e49f3b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.929494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb3db48d8d64e689e1d89dcb6e49f3b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.931533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.996018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80268bf-0516-40a3-9ebe-d3abc45d9feb None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.999912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37f9f9-cab5-48fd-a42a-9339d918ef8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.000546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37f9f9-cab5-48fd-a42a-9339d918ef8c service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.000883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37f9f9-cab5-48fd-a42a-9339d918ef8c service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.001102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37f9f9-cab5-48fd-a42a-9339d918ef8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.011024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37f9f9-cab5-48fd-a42a-9339d918ef8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.012544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37f9f9-cab5-48fd-a42a-9339d918ef8c service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.023510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1035/2064] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:28.038658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb3db48d8d64e689e1d89dcb6e49f3b', 'request_id': 'req-56b26d14-102e-4c92-96d6-670076784048'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.041743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb3db48d8d64e689e1d89dcb6e49f3b', 'request_id': 'req-56b26d14-102e-4c92-96d6-670076784048'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.106307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb3db48d8d64e689e1d89dcb6e49f3b', 'request_id': 'req-56b26d14-102e-4c92-96d6-670076784048'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.119451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] The token cache is being invalidate because project cdb3db48d8d64e689e1d89dcb6e49f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:28.119755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.120444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-56b26d14-102e-4c92-96d6-670076784048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:28.121976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1030/2065] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:27 2022] DELETE /identity/v3/projects/cdb3db48d8d64e689e1d89dcb6e49f3b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:28.129612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d08d7-2ff6-48af-98d2-87e14001fe6b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.130022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d08d7-2ff6-48af-98d2-87e14001fe6b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.130373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d08d7-2ff6-48af-98d2-87e14001fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.154896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a70d08d7-2ff6-48af-98d2-87e14001fe6b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:28.157103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a70d08d7-2ff6-48af-98d2-87e14001fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:28.239446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1036/2066] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:28.247852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b12fd-045a-4ff4-8a6d-67d09c02bdf7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.248139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b12fd-045a-4ff4-8a6d-67d09c02bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.248566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b12fd-045a-4ff4-8a6d-67d09c02bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.272169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a08b12fd-045a-4ff4-8a6d-67d09c02bdf7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:28.273622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a08b12fd-045a-4ff4-8a6d-67d09c02bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:28.283387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1031/2067] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:28.288758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d08d7-2ff6-48af-98d2-87e14001fe6b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.301184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d08d7-2ff6-48af-98d2-87e14001fe6b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.306587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.307238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.307591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.307870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.308534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:28.308837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.310735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.327497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1037/2068] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:28.331947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b12fd-045a-4ff4-8a6d-67d09c02bdf7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.341674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b12fd-045a-4ff4-8a6d-67d09c02bdf7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.347799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.348795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.349254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.349584 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.350192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.352237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.445393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1032/2069] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:28.446963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.459553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff300-e698-45ab-9fab-82d95812b85c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.469140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:28.532431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.533109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.533290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.533570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.534254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.536524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.601418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1038/2070] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:28.602971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.614277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4214-7666-4e1e-af03-c35151f81e36 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.619072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.619741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.620027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.620299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.620985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.622712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.633809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1033/2071] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:28.637866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.648988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00e81-2e9b-4f50-bd98-86ca3fa8d6f1 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.653963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68449fdd-80dc-48a0-b382-7d37b63876ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.654579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68449fdd-80dc-48a0-b382-7d37b63876ad admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.654858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68449fdd-80dc-48a0-b382-7d37b63876ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.655130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68449fdd-80dc-48a0-b382-7d37b63876ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.655821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68449fdd-80dc-48a0-b382-7d37b63876ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.657498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68449fdd-80dc-48a0-b382-7d37b63876ad admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.672711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1039/2072] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:28.673977 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:28.686276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee212aa9-b683-4939-a9a9-d4d391c0441f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:28.693331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:28.693331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.693331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.693331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] PATH_INFO: `/v3/projects/656ade530aa745458b703f20c54bf461/users/a272442dffb64e26947b96520abb9589/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.719192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656ade530aa745458b703f20c54bf461, user_id=a272442dffb64e26947b96520abb9589, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:28.722617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:28.809790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1034/2073] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:28 2022] PUT /identity/v3/projects/656ade530aa745458b703f20c54bf461/users/a272442dffb64e26947b96520abb9589/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:28.821978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:28.822269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:28.822599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:28.863395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] MFA Rules not processed for user `a272442dffb64e26947b96520abb9589`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:28.866449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:28.939973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1040/2074] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:28.944433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.014064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:29.018744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2099-d4e6-49f6-9aaf-2add9e92bd59 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.023744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.024402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.024684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.024961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.025613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.027549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.087992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.089495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:29.136725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1035/2075] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:28 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:29.141241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.157991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1549d1-a7e5-458b-9336-86c166cd6ca3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.194140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:29.211936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.212566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.212849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.213122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.214917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:29.215759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69890a-002d-41f0-a305-9946243a79af admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.220488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.221323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.221428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.221910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.222265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.224437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.280766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.282346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.292701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1041/2076] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:29.320518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1036/2077] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:29 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:29.321250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.333303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417dc2-bc0f-4c25-a641-21b200099f39 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.338007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.339214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.339214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.339214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.345814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.345814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.360412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1042/2078] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:29.365612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.376387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3fc5-4e0a-4169-84c7-50d0b9aacbf3 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.383440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.384525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.384903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.385108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] PATH_INFO: `/v3/projects/2f5924a88fce45759dcc1bb3913cbea6/users/1c92bb1365094e5f8aa248cf31646ed7/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.403930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5924a88fce45759dcc1bb3913cbea6, user_id=1c92bb1365094e5f8aa248cf31646ed7, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.406627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.538014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1037/2079] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:29 2022] PUT /identity/v3/projects/2f5924a88fce45759dcc1bb3913cbea6/users/1c92bb1365094e5f8aa248cf31646ed7/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:29.542033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.556053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a598d-fe92-4b28-8109-433b7c06d79a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.640615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296febd-22fc-4846-a232-4dbf44e43203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.641230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296febd-22fc-4846-a232-4dbf44e43203 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.641513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296febd-22fc-4846-a232-4dbf44e43203 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.641784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296febd-22fc-4846-a232-4dbf44e43203 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.642698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296febd-22fc-4846-a232-4dbf44e43203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.644379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296febd-22fc-4846-a232-4dbf44e43203 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.654406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1043/2080] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:29.659179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.669914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55df4db-a8bf-425b-b599-3f94f81f3f10 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:29.675314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:29.676019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.676299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.676572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] PATH_INFO: `/v3/projects/2f5924a88fce45759dcc1bb3913cbea6/users/1c92bb1365094e5f8aa248cf31646ed7/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.678528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5924a88fce45759dcc1bb3913cbea6, user_id=1c92bb1365094e5f8aa248cf31646ed7, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:29.681238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:29.692244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1038/2081] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:29 2022] PUT /identity/v3/projects/2f5924a88fce45759dcc1bb3913cbea6/users/1c92bb1365094e5f8aa248cf31646ed7/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:29.702677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc218d-f210-415f-943d-d7a34ed0ec6b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.702964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc218d-f210-415f-943d-d7a34ed0ec6b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.703242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc218d-f210-415f-943d-d7a34ed0ec6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.739609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bcbc218d-f210-415f-943d-d7a34ed0ec6b None None] MFA Rules not processed for user `1c92bb1365094e5f8aa248cf31646ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:29.741267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bcbc218d-f210-415f-943d-d7a34ed0ec6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:29.839327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:29.854945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1044/2082] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:29.926408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:29.982040 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7039c5-274d-4e66-a4e1-dffa86ccede2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.056625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ed689-f82d-40eb-9c05-c759f3f2bc5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.056625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed689-f82d-40eb-9c05-c759f3f2bc5b service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.056625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed689-f82d-40eb-9c05-c759f3f2bc5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.056625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed689-f82d-40eb-9c05-c759f3f2bc5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.058328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ed689-f82d-40eb-9c05-c759f3f2bc5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.058328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ed689-f82d-40eb-9c05-c759f3f2bc5b service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.058328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1039/2083] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:32.624002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc218d-f210-415f-943d-d7a34ed0ec6b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:32.709430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc218d-f210-415f-943d-d7a34ed0ec6b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:32.715331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:32.716010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:32.716299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:32.717833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] PATH_INFO: `/v3/users/a272442dffb64e26947b96520abb9589` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:32.719036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a272442dffb64e26947b96520abb9589)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:32.721115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:32.952118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a272442dffb64e26947b96520abb9589'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:32.961390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a272442dffb64e26947b96520abb9589'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:32.962470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a272442dffb64e26947b96520abb9589'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:32.976923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a272442dffb64e26947b96520abb9589'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:33.050172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a272442dffb64e26947b96520abb9589'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:33.059512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1045/2084] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:32 2022] DELETE /identity/v3/users/a272442dffb64e26947b96520abb9589 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:33.066262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.067100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.067100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.119584 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:33.119705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.203443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:33.278146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1040/2085] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:33.285588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:33.287453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.376829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb155-fb24-436f-bc60-ad9cc0aec987 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:33.380979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:33.381611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.381891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.382166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.392154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:33.394228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:33.405053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1046/2086] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:33.885677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:33.887651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.903125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780aaa5-c31a-4663-88e0-7eb9543402c8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:33.908490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:33.911591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.911591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.911591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] PATH_INFO: `/v3/projects/656ade530aa745458b703f20c54bf461` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.911591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656ade530aa745458b703f20c54bf461)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:33.913646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.036993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656ade530aa745458b703f20c54bf461', 'request_id': 'req-237cb902-1e88-490e-9262-02ed7a13f4e0'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.045076 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656ade530aa745458b703f20c54bf461', 'request_id': 'req-237cb902-1e88-490e-9262-02ed7a13f4e0'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.122925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656ade530aa745458b703f20c54bf461', 'request_id': 'req-237cb902-1e88-490e-9262-02ed7a13f4e0'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.135921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] The token cache is being invalidate because project 656ade530aa745458b703f20c54bf461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:34.136110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.136783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.138299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1041/2087] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:33 2022] DELETE /identity/v3/projects/656ade530aa745458b703f20c54bf461 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:34.142631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.153729 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158ea9d-0754-413c-ac78-4f2bd3c59168 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.170858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.216714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.217350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.217629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.217912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] PATH_INFO: `/v3/users/1c92bb1365094e5f8aa248cf31646ed7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.219064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c92bb1365094e5f8aa248cf31646ed7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.221084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.446580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c92bb1365094e5f8aa248cf31646ed7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.454493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c92bb1365094e5f8aa248cf31646ed7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.455634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c92bb1365094e5f8aa248cf31646ed7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.470275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c92bb1365094e5f8aa248cf31646ed7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.597313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0c9042ce-29fb-4770-9695-cb474c38cbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c92bb1365094e5f8aa248cf31646ed7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:34.609808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1047/2088] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:34 2022] DELETE /identity/v3/users/1c92bb1365094e5f8aa248cf31646ed7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:35.101424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:35.102899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:35.117104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb902-1e88-490e-9262-02ed7a13f4e0 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:35.176577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:35.177338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.177565 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.178272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] PATH_INFO: `/v3/projects/2f5924a88fce45759dcc1bb3913cbea6` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.180019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5924a88fce45759dcc1bb3913cbea6)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:35.182605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:35.294910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5924a88fce45759dcc1bb3913cbea6', 'request_id': 'req-53273a4b-c90f-4147-85f4-ae2e3fa80179'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:35.300991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5924a88fce45759dcc1bb3913cbea6', 'request_id': 'req-53273a4b-c90f-4147-85f4-ae2e3fa80179'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:35.304709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:35.351602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5924a88fce45759dcc1bb3913cbea6', 'request_id': 'req-53273a4b-c90f-4147-85f4-ae2e3fa80179'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:35.364382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] The token cache is being invalidate because project 2f5924a88fce45759dcc1bb3913cbea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:35.364669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:35.365312 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-53273a4b-c90f-4147-85f4-ae2e3fa80179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:35.366827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1042/2089] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:35 2022] DELETE /identity/v3/projects/2f5924a88fce45759dcc1bb3913cbea6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:35.371667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3cbb8-70bf-4485-90d6-ef16bb55e9de None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.380803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3cbb8-70bf-4485-90d6-ef16bb55e9de None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.380803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3cbb8-70bf-4485-90d6-ef16bb55e9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.393861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-09b3cbb8-70bf-4485-90d6-ef16bb55e9de None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:35.395196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-09b3cbb8-70bf-4485-90d6-ef16bb55e9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:35.461758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1048/2090] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:35.470613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0db1-072d-4970-bc5b-7e3cc87e5e9b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.470894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0db1-072d-4970-bc5b-7e3cc87e5e9b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.478150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0db1-072d-4970-bc5b-7e3cc87e5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.492479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-af4b0db1-072d-4970-bc5b-7e3cc87e5e9b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:35.493652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-af4b0db1-072d-4970-bc5b-7e3cc87e5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:35.501523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1043/2091] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:35.506057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3cbb8-70bf-4485-90d6-ef16bb55e9de None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:35.516225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3cbb8-70bf-4485-90d6-ef16bb55e9de None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:35.521781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:35.522577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.522936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.523284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.524156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:35.524555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:35.526271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:35.539765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1049/2092] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:35.544139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0db1-072d-4970-bc5b-7e3cc87e5e9b None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:35.554535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0db1-072d-4970-bc5b-7e3cc87e5e9b None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:35.559941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:35.560644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.561075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.561373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.562160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:35.564135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:35.676746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1044/2093] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:35 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:35.677928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:35.688706 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038268-3324-45a2-9b6c-04df3a977652 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:35.711740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:35.752279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:35.752894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.753171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.761325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.762582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:35.765527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:35.877184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1050/2094] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:35 2022] POST /identity/v3/users => generated 281 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:35.881877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:35.893861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd61596-b346-4624-87aa-0ef59fe58335 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:35.898961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:35.899617 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.899903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.900184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.900863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:35.902474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:35.913994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1045/2095] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:35.918065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:35.928274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796847b9-54d7-408a-a001-d2dbc62c30d9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:35.933146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755956b-4a82-4c0b-9161-f71e84ef2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:35.933741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755956b-4a82-4c0b-9161-f71e84ef2546 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.934026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755956b-4a82-4c0b-9161-f71e84ef2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.934300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755956b-4a82-4c0b-9161-f71e84ef2546 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.934981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755956b-4a82-4c0b-9161-f71e84ef2546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:35.936658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755956b-4a82-4c0b-9161-f71e84ef2546 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:35.946636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1051/2096] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:35.950753 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:35.961217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b424fb8-8663-4ef9-a05a-ab5175412ffd admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:35.965986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:35.966639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:35.966922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:35.967194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] PATH_INFO: `/v3/projects/45a1d677eec04d2aa035301dce3863c2/users/64c08b56f9d549989981e02954fcda15/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:35.982243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a1d677eec04d2aa035301dce3863c2, user_id=64c08b56f9d549989981e02954fcda15, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:35.985054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:36.055625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1046/2097] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:35 2022] PUT /identity/v3/projects/45a1d677eec04d2aa035301dce3863c2/users/64c08b56f9d549989981e02954fcda15/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:36.066230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd648-5f01-4cbd-8def-594894c4dd75 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.066523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd648-5f01-4cbd-8def-594894c4dd75 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.066805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd648-5f01-4cbd-8def-594894c4dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.096667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-39bdd648-5f01-4cbd-8def-594894c4dd75 None None] MFA Rules not processed for user `64c08b56f9d549989981e02954fcda15`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:36.097931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-39bdd648-5f01-4cbd-8def-594894c4dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:36.161987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1052/2098] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:36.196849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:36.199109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:36.258533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4134c0a-758d-4ad5-a20e-6b079927a08d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:36.262337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9c2b-cf43-4070-9325-73c7682d23e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:36.262945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9c2b-cf43-4070-9325-73c7682d23e1 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.263226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9c2b-cf43-4070-9325-73c7682d23e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.263539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9c2b-cf43-4070-9325-73c7682d23e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.273929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9c2b-cf43-4070-9325-73c7682d23e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:36.276358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9c2b-cf43-4070-9325-73c7682d23e1 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:36.284991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1047/2099] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:36.300477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdd648-5f01-4cbd-8def-594894c4dd75 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:36.368671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdd648-5f01-4cbd-8def-594894c4dd75 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:36.373401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:36.374046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.374328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.374605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] PATH_INFO: `/v3/users/64c08b56f9d549989981e02954fcda15` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.375827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c08b56f9d549989981e02954fcda15)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:36.378379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:36.545364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:36.556028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c08b56f9d549989981e02954fcda15'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:36.563852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c08b56f9d549989981e02954fcda15'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:36.564567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c08b56f9d549989981e02954fcda15'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:36.577126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c08b56f9d549989981e02954fcda15'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:36.636285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c08b56f9d549989981e02954fcda15'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:36.643870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1053/2100] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:36 2022] DELETE /identity/v3/users/64c08b56f9d549989981e02954fcda15 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:36.648474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.648887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.653787 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.669932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:36.671236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:36.737923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1048/2101] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:36.747917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:36.749474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:36.884821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc3fbf-33df-487e-b099-31715d844b04 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:36.888985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44a046-abb2-4083-9da8-4cb53387a916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:36.889608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44a046-abb2-4083-9da8-4cb53387a916 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.889895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44a046-abb2-4083-9da8-4cb53387a916 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.890166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44a046-abb2-4083-9da8-4cb53387a916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.900639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44a046-abb2-4083-9da8-4cb53387a916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:36.902092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44a046-abb2-4083-9da8-4cb53387a916 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:36.914170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1054/2102] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:37.504746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.507174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:37.521039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d34137-c163-48b6-b764-ce45d63825f0 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.542176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.542176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.542176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.542176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] PATH_INFO: `/v3/projects/45a1d677eec04d2aa035301dce3863c2` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.543215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a1d677eec04d2aa035301dce3863c2)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.545199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:37.644853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:37.668302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a1d677eec04d2aa035301dce3863c2', 'request_id': 'req-0f8408a2-9860-44ba-a0e1-6389cfd35248'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:37.675974 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a1d677eec04d2aa035301dce3863c2', 'request_id': 'req-0f8408a2-9860-44ba-a0e1-6389cfd35248'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:37.757163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a1d677eec04d2aa035301dce3863c2', 'request_id': 'req-0f8408a2-9860-44ba-a0e1-6389cfd35248'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:37.770329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] The token cache is being invalidate because project 45a1d677eec04d2aa035301dce3863c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:37.772688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:37.773419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0f8408a2-9860-44ba-a0e1-6389cfd35248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:37.774980 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1049/2103] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:37 2022] DELETE /identity/v3/projects/45a1d677eec04d2aa035301dce3863c2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:37.780013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce7f6c-af6a-4295-b79e-647de65e986f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.780518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce7f6c-af6a-4295-b79e-647de65e986f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.780635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce7f6c-af6a-4295-b79e-647de65e986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.803191 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-91ce7f6c-af6a-4295-b79e-647de65e986f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:37.804464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-91ce7f6c-af6a-4295-b79e-647de65e986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:37.870138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1055/2104] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:37.878800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769017-5232-4412-8f0d-5ff263dc8a12 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.879136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769017-5232-4412-8f0d-5ff263dc8a12 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.879348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769017-5232-4412-8f0d-5ff263dc8a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.900969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-34769017-5232-4412-8f0d-5ff263dc8a12 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:37.902295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-34769017-5232-4412-8f0d-5ff263dc8a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:37.910532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1050/2105] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:37.914720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce7f6c-af6a-4295-b79e-647de65e986f None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.924428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce7f6c-af6a-4295-b79e-647de65e986f None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.929509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.930132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.930418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.930691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.931381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:37.931817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.933444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:37.947482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1056/2106] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:37.952984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34769017-5232-4412-8f0d-5ff263dc8a12 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.964728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34769017-5232-4412-8f0d-5ff263dc8a12 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.969562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.970210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.970492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.970778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.971437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.973422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.063308 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1051/2107] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:37 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:38.069040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:38.081484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de464468-d423-486d-917e-ecf8862cb4a6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:38.168982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:38.190966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:38.192503 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.192848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.193131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.194239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:38.196810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.328802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1057/2108] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:38 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:38.330562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:38.346435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d711142-0353-4a91-a227-648b55209b6e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:38.355885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:38.356171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.356171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.356171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.356171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:38.360997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.376747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1052/2109] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:38.381003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:38.393159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c27690-517b-44bc-b75f-6714382acde0 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:38.398415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf03cfb-195f-4046-a54f-8c6cb953d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:38.399256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03cfb-195f-4046-a54f-8c6cb953d2ef admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.399715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03cfb-195f-4046-a54f-8c6cb953d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.405182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03cfb-195f-4046-a54f-8c6cb953d2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.406001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf03cfb-195f-4046-a54f-8c6cb953d2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:38.407833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf03cfb-195f-4046-a54f-8c6cb953d2ef admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.421986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1058/2110] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:38.426793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:38.437613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a9e1-8838-4371-ac70-550e60ff9406 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:38.443163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:38.443875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.444153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.444668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] PATH_INFO: `/v3/projects/fd5dbc5f0e6942c6bc6a0b6f1ff59644/users/258f2a68807b4b9da1d538c918eab720/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.461359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5dbc5f0e6942c6bc6a0b6f1ff59644, user_id=258f2a68807b4b9da1d538c918eab720, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:38.464110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.534748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1053/2111] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:38 2022] PUT /identity/v3/projects/fd5dbc5f0e6942c6bc6a0b6f1ff59644/users/258f2a68807b4b9da1d538c918eab720/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:38.546073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.546520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.546623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.582548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] MFA Rules not processed for user `258f2a68807b4b9da1d538c918eab720`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:38.583724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:38.663933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1059/2112] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:38.675571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:38.677499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:38.762449 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26ffd0-f4d9-4792-843f-f9276442be3b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:38.765663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07a34f-3cc5-4d2a-ae97-1403e6a6ef45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:38.766284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07a34f-3cc5-4d2a-ae97-1403e6a6ef45 service glance] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.766568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07a34f-3cc5-4d2a-ae97-1403e6a6ef45 service glance] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.766846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07a34f-3cc5-4d2a-ae97-1403e6a6ef45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.777052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07a34f-3cc5-4d2a-ae97-1403e6a6ef45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:38.778494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07a34f-3cc5-4d2a-ae97-1403e6a6ef45 service glance] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.788265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1054/2113] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:40.534094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:40.535743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:40.622886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d7bf0-ad6e-4c75-9eed-6b446b16ff9d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:40.628394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:40.629350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:40.629700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:40.630064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] PATH_INFO: `/v3/users/e2e1d5acbe554e64b8a716f8241e427a` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:40.633009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e1d5acbe554e64b8a716f8241e427a)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:40.636801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:40.998667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e1d5acbe554e64b8a716f8241e427a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:41.004756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:41.014620 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e1d5acbe554e64b8a716f8241e427a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:41.018411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e1d5acbe554e64b8a716f8241e427a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:41.035005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e1d5acbe554e64b8a716f8241e427a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:41.134412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e1d5acbe554e64b8a716f8241e427a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:41.140896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1060/2114] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:40 2022] DELETE /identity/v3/users/e2e1d5acbe554e64b8a716f8241e427a => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:41.146663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.147204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.147204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.169319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:41.171301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:41.209357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:41.248652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1055/2115] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:41.264027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:41.265764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:41.359430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7688f9-1f49-4bc3-aa26-387910605bd5 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:41.365252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:41.368044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.368044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.368044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.378832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:41.380676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:41.393803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1061/2116] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:41.918494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:41.923573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:41.941168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d673a-b67b-4550-a26a-bfc0f192fa23 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:41.948264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:41.949321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.950378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.951110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] PATH_INFO: `/v3/projects/d4646d0a39294d41903c42443888bd32` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.953427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4646d0a39294d41903c42443888bd32)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:41.956998 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:42.079790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4646d0a39294d41903c42443888bd32', 'request_id': 'req-6a67683d-573c-4b73-8d50-a1b46ed05547'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.086561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4646d0a39294d41903c42443888bd32', 'request_id': 'req-6a67683d-573c-4b73-8d50-a1b46ed05547'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.220135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4646d0a39294d41903c42443888bd32', 'request_id': 'req-6a67683d-573c-4b73-8d50-a1b46ed05547'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.234210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] The token cache is being invalidate because project d4646d0a39294d41903c42443888bd32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:42.234507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.235446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.237228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1056/2117] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:41 2022] DELETE /identity/v3/projects/d4646d0a39294d41903c42443888bd32 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:42.241772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:42.252884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7451682-1736-41ba-83d5-c83932a8803c service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:42.324862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:42.325909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:42.326370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:42.326911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] PATH_INFO: `/v3/users/c2c34b0525f040c3b3d43fdb1dec2b55` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:42.329173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c34b0525f040c3b3d43fdb1dec2b55)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:42.332067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:42.527349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c34b0525f040c3b3d43fdb1dec2b55'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.538544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c34b0525f040c3b3d43fdb1dec2b55'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.539468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c34b0525f040c3b3d43fdb1dec2b55'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.554558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c34b0525f040c3b3d43fdb1dec2b55'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.556558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:42.682570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c34b0525f040c3b3d43fdb1dec2b55'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:42.690627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1062/2118] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:42 2022] DELETE /identity/v3/users/c2c34b0525f040c3b3d43fdb1dec2b55 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:43.152154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:43.153710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:43.180447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67683d-573c-4b73-8d50-a1b46ed05547 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:43.266726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:43.268302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:43.268589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:43.268863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] PATH_INFO: `/v3/projects/a992b2e11d844736b45277b2a5a66133` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:43.270012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a992b2e11d844736b45277b2a5a66133)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:43.272026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:43.375746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a992b2e11d844736b45277b2a5a66133', 'request_id': 'req-bb096720-37fc-4252-ad6d-2e96d3b6e21f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.383205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a992b2e11d844736b45277b2a5a66133', 'request_id': 'req-bb096720-37fc-4252-ad6d-2e96d3b6e21f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.384285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:43.482798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a992b2e11d844736b45277b2a5a66133', 'request_id': 'req-bb096720-37fc-4252-ad6d-2e96d3b6e21f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.497871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] The token cache is being invalidate because project a992b2e11d844736b45277b2a5a66133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:43.498228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.498945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.500533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1057/2119] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:43 2022] DELETE /identity/v3/projects/a992b2e11d844736b45277b2a5a66133 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:43.513784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:43.516234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:43.539753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ab0f-50b7-426e-bfc5-46d5670dc865 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:43.603801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:43.604367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:43.604652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:43.604933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] PATH_INFO: `/v3/users/7679de82911d45bbb047c1e27e20974a` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:43.606121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7679de82911d45bbb047c1e27e20974a)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:43.608168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:43.869522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7679de82911d45bbb047c1e27e20974a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.876621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7679de82911d45bbb047c1e27e20974a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.877366 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7679de82911d45bbb047c1e27e20974a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.889594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7679de82911d45bbb047c1e27e20974a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.979928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-60f797e6-7a1e-40b5-a231-7857d3f1e05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7679de82911d45bbb047c1e27e20974a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:43.990100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1063/2120] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:43 2022] DELETE /identity/v3/users/7679de82911d45bbb047c1e27e20974a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:44.485752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:44.487294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:44.502814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096720-37fc-4252-ad6d-2e96d3b6e21f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:44.574597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:44.575240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.575555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.575829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] PATH_INFO: `/v3/projects/4e2559acd50345619f3777acaec78962` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.577023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2559acd50345619f3777acaec78962)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:44.578977 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:44.678382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2559acd50345619f3777acaec78962', 'request_id': 'req-2432f627-257a-4e95-a70b-de2375567245'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:44.684327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2559acd50345619f3777acaec78962', 'request_id': 'req-2432f627-257a-4e95-a70b-de2375567245'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:44.728074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2559acd50345619f3777acaec78962', 'request_id': 'req-2432f627-257a-4e95-a70b-de2375567245'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:44.740330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] The token cache is being invalidate because project 4e2559acd50345619f3777acaec78962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:44.740742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:44.741485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2432f627-257a-4e95-a70b-de2375567245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:44.743667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1058/2121] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:44 2022] DELETE /identity/v3/projects/4e2559acd50345619f3777acaec78962 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:44.748658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487fd10-b6a9-49d9-9910-5bb2a62d9521 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.749184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487fd10-b6a9-49d9-9910-5bb2a62d9521 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.749184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487fd10-b6a9-49d9-9910-5bb2a62d9521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.772227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9487fd10-b6a9-49d9-9910-5bb2a62d9521 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:44.773455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9487fd10-b6a9-49d9-9910-5bb2a62d9521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:44.837239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1064/2122] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:44.844679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c77f-84f3-497a-8318-851fe32bbfb1 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.844969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c77f-84f3-497a-8318-851fe32bbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.845249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c77f-84f3-497a-8318-851fe32bbfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.867852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c477c77f-84f3-497a-8318-851fe32bbfb1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:44.869082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c477c77f-84f3-497a-8318-851fe32bbfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:44.877749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1059/2123] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:44.882036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487fd10-b6a9-49d9-9910-5bb2a62d9521 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:44.892851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487fd10-b6a9-49d9-9910-5bb2a62d9521 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:44.897985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:44.898592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.898879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.899157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.899844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:44.900151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:44.901786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:44.909534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:44.914676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1065/2124] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:44.926679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c77f-84f3-497a-8318-851fe32bbfb1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:44.936389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c77f-84f3-497a-8318-851fe32bbfb1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:44.941653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:44.942254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.942533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.942808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.943475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:44.945383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.038351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1060/2125] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:44 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:45.042645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.053131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f636fb-805f-458c-b4ee-78fc29971386 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.110649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.112278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.112639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.112874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.113700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.115946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.211844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1066/2126] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:45 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:45.213038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.224316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc8f6d-d681-4581-98eb-18fa9f8f05f1 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.229907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.230888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.230997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.231298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.232006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.233595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.248107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1061/2127] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:45.249357 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.259330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1dbd9-1980-40a4-9a8f-ecd7c9a17eb0 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.264426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae3f3-505b-4d79-9c8c-8e996dcb7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.265028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae3f3-505b-4d79-9c8c-8e996dcb7caf admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.265312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae3f3-505b-4d79-9c8c-8e996dcb7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.265588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae3f3-505b-4d79-9c8c-8e996dcb7caf admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.266245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae3f3-505b-4d79-9c8c-8e996dcb7caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.268179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae3f3-505b-4d79-9c8c-8e996dcb7caf admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.279194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1067/2128] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:45.283867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.294108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8acb1a-fe66-4793-8b38-e9e610f14264 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.299524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.300189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.300468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.300743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] PATH_INFO: `/v3/projects/72ad55ae3f71435eadffb17e16280e3a/users/5ebfa36ddb0f4e299ce66c68287f1f3f/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.315575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ad55ae3f71435eadffb17e16280e3a, user_id=5ebfa36ddb0f4e299ce66c68287f1f3f, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.318227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.402652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1062/2129] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:45 2022] PUT /identity/v3/projects/72ad55ae3f71435eadffb17e16280e3a/users/5ebfa36ddb0f4e299ce66c68287f1f3f/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:45.414410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb018a4-50e8-47f5-972d-54ee02673092 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.414833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb018a4-50e8-47f5-972d-54ee02673092 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.415183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb018a4-50e8-47f5-972d-54ee02673092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.451663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8cb018a4-50e8-47f5-972d-54ee02673092 None None] MFA Rules not processed for user `5ebfa36ddb0f4e299ce66c68287f1f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:45.453010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8cb018a4-50e8-47f5-972d-54ee02673092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:45.540629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1068/2130] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:45.545132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.569775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:45.633722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc452f8-6b80-425e-8f8a-89e1f1b9f891 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.638951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.639602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.639886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.640161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.640798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.643780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.717814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1063/2131] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:45 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:45.722294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb018a4-50e8-47f5-972d-54ee02673092 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.733624 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb018a4-50e8-47f5-972d-54ee02673092 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.790583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.791299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.791569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.791767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.792430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.794405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.807449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:45.900770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1069/2132] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:45 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:45.904671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.915500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435fd8-15b4-4a15-a83c-a458ed0f85cf admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.920204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.920799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.921075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.921356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.921995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.923606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.933979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1064/2133] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:45.937962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.948691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c70be4-ce14-4b72-8423-6cc6fc800034 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.953589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48c1ac-8200-4cd7-9583-05bff181eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.954208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c1ac-8200-4cd7-9583-05bff181eacc admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.954494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c1ac-8200-4cd7-9583-05bff181eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.954768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c1ac-8200-4cd7-9583-05bff181eacc admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.956046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48c1ac-8200-4cd7-9583-05bff181eacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.957676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48c1ac-8200-4cd7-9583-05bff181eacc admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.969044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1070/2134] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:45.972957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.982845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baed5d-051b-4eff-ab54-b73b246f3cdc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.987467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.988134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.988411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.988682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] PATH_INFO: `/v3/projects/d5ae5f3123714a47b9aa1168652263d1/users/4205e44a228949fea1f08509aa82a75c/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.004293 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ae5f3123714a47b9aa1168652263d1, user_id=4205e44a228949fea1f08509aa82a75c, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:46.006950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:46.077248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1065/2135] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:45 2022] PUT /identity/v3/projects/d5ae5f3123714a47b9aa1168652263d1/users/4205e44a228949fea1f08509aa82a75c/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:46.088166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4dab-e96f-4c69-abe6-60cc766fcb7e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.088458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4dab-e96f-4c69-abe6-60cc766fcb7e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.088722 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4dab-e96f-4c69-abe6-60cc766fcb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.119108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-38fd4dab-e96f-4c69-abe6-60cc766fcb7e None None] MFA Rules not processed for user `4205e44a228949fea1f08509aa82a75c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:46.120524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-38fd4dab-e96f-4c69-abe6-60cc766fcb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:46.195299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1071/2136] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:46.200372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:46.274807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468b06f-bfd0-464a-a2a7-0cc3f2b67755 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:46.279975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:46.280657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.281009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.281353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.282061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:46.284213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:46.398462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1066/2137] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:46 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:46.402539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd4dab-e96f-4c69-abe6-60cc766fcb7e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:46.413583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd4dab-e96f-4c69-abe6-60cc766fcb7e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:46.473329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:46.473940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.474227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.474506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.475136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:46.477124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:46.562675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1072/2138] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:46 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:46.567952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:46.579810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083735b-e3eb-4b16-95ea-a62fafa2c115 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:46.584780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:46.585439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.585723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.586001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.586665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:46.588326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:46.599675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1067/2139] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:46.603878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:46.614681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356141c0-ca0d-427c-9bff-35dd47ef013b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:46.619317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:46.619998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.620283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.620560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] PATH_INFO: `/v3/projects/d0cdf77914d14cea88a05d16a5cbc6aa/users/68c897f98af842b985f2cd392147b190/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.637836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf77914d14cea88a05d16a5cbc6aa, user_id=68c897f98af842b985f2cd392147b190, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:46.640575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:46.717222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1073/2140] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:46 2022] PUT /identity/v3/projects/d0cdf77914d14cea88a05d16a5cbc6aa/users/68c897f98af842b985f2cd392147b190/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:46.721914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:46.732434 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113928e5-896a-4cb9-9cac-a73aa2c8bdce admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:46.773290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:46.799631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c553712-c961-46e7-9207-76349ea91dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:46.800246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553712-c961-46e7-9207-76349ea91dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.800536 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553712-c961-46e7-9207-76349ea91dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.800803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553712-c961-46e7-9207-76349ea91dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.801451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c553712-c961-46e7-9207-76349ea91dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:46.803200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c553712-c961-46e7-9207-76349ea91dd1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:46.813618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1068/2141] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:46.817791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:46.829121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b7f69-dc87-4a61-bfc2-c7a68482532e admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:46.833941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:46.834644 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.834930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.835204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] PATH_INFO: `/v3/projects/d0cdf77914d14cea88a05d16a5cbc6aa/users/68c897f98af842b985f2cd392147b190/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.837225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cdf77914d14cea88a05d16a5cbc6aa, user_id=68c897f98af842b985f2cd392147b190, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:46.839946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:46.851092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1074/2142] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:46 2022] PUT /identity/v3/projects/d0cdf77914d14cea88a05d16a5cbc6aa/users/68c897f98af842b985f2cd392147b190/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:46.861364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be44a30-8df2-4d2e-a1b0-f2c28298ce19 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.862187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be44a30-8df2-4d2e-a1b0-f2c28298ce19 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.862469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be44a30-8df2-4d2e-a1b0-f2c28298ce19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.890283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1be44a30-8df2-4d2e-a1b0-f2c28298ce19 None None] MFA Rules not processed for user `68c897f98af842b985f2cd392147b190`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:46.891514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1be44a30-8df2-4d2e-a1b0-f2c28298ce19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:46.978093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1069/2143] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:46.990231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:46.992268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:47.026346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:47.054752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88bfa2-12d4-4feb-a99e-cd4b933dbbec admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:47.058829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:47.059495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:47.059778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:47.060096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:47.122793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:47.124746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:47.135167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1075/2144] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:49.098920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be44a30-8df2-4d2e-a1b0-f2c28298ce19 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:49.110598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be44a30-8df2-4d2e-a1b0-f2c28298ce19 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:49.116019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb7d63-ab21-4689-a86a-097f09aa9449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:49.116653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb7d63-ab21-4689-a86a-097f09aa9449 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:49.116930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb7d63-ab21-4689-a86a-097f09aa9449 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:49.117226 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb7d63-ab21-4689-a86a-097f09aa9449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:49.192367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb7d63-ab21-4689-a86a-097f09aa9449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:49.195634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb7d63-ab21-4689-a86a-097f09aa9449 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:49.206399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1070/2145] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:49.868016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:49.869640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:49.944384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62e74-af35-4c5c-9602-bc59881a0d66 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:49.949121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:49.949758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:49.950044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:49.950339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] PATH_INFO: `/v3/users/0dea5bc22e164aa485cbc1b6a4967ba0` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:49.951484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dea5bc22e164aa485cbc1b6a4967ba0)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:49.953445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:50.166427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dea5bc22e164aa485cbc1b6a4967ba0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:50.174243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dea5bc22e164aa485cbc1b6a4967ba0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:50.174975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dea5bc22e164aa485cbc1b6a4967ba0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:50.191985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dea5bc22e164aa485cbc1b6a4967ba0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:50.276005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dea5bc22e164aa485cbc1b6a4967ba0'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:50.278646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:50.283521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1076/2146] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:49 2022] DELETE /identity/v3/users/0dea5bc22e164aa485cbc1b6a4967ba0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:50.288214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:50.288702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:50.288815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:50.309719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:50.311100 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:50.374965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:50.385488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1071/2147] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:50.396574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:50.398197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:50.460236 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a657949-5ff7-47ea-aa16-94a1860d1696 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:50.463833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:50.464435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:50.464711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:50.464978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:50.476603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:50.478067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:50.488579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1077/2148] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:50.959017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:50.960815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:50.993401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a998c5-ccc9-43d1-a19c-9dda5d0893b5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.000342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.001350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.002585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.002914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] PATH_INFO: `/v3/projects/9f611ef9aafe440897b57f131406157f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.004512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f611ef9aafe440897b57f131406157f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.007079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.120377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.121954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:51.186006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f611ef9aafe440897b57f131406157f', 'request_id': 'req-eef9f68f-63e7-472a-bae5-d96c72e02826'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.187332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784d896-a654-42d8-adc6-d6ba46aefbfa service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.192542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f611ef9aafe440897b57f131406157f', 'request_id': 'req-eef9f68f-63e7-472a-bae5-d96c72e02826'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.247960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.248702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.248983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.249255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.251063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:51.294188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f611ef9aafe440897b57f131406157f', 'request_id': 'req-eef9f68f-63e7-472a-bae5-d96c72e02826'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.308161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] The token cache is being invalidate because project 9f611ef9aafe440897b57f131406157f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:51.308506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.309183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.310856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1072/2149] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:50 2022] DELETE /identity/v3/projects/9f611ef9aafe440897b57f131406157f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:51.314819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.316236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:51.322025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.324042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.335975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1078/2150] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:54:51.420317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9f68f-63e7-472a-bae5-d96c72e02826 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.423136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.424418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.424699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.424968 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] PATH_INFO: `/v3/users/1d5605840291436eb276c31b83d96ff1` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.426137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5605840291436eb276c31b83d96ff1)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.428107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.700422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5605840291436eb276c31b83d96ff1'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.701232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5605840291436eb276c31b83d96ff1'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.710028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5605840291436eb276c31b83d96ff1'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.710893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5605840291436eb276c31b83d96ff1'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.727424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e65187e2-1284-494f-9e27-873f317910d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5605840291436eb276c31b83d96ff1'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:51.792143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:51.796781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1073/2151] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:54:51 2022] DELETE /identity/v3/users/1d5605840291436eb276c31b83d96ff1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:52.286166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:52.305082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a592d2-70b6-4736-b7a0-f7d91ff114aa service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:52.353320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:52.443894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:52.444710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:52.444993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:52.445299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] PATH_INFO: `/v3/projects/e6434a79419c48be935597b67ea2185f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:52.446532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6434a79419c48be935597b67ea2185f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:52.448582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:52.602271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6434a79419c48be935597b67ea2185f', 'request_id': 'req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:52.610877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6434a79419c48be935597b67ea2185f', 'request_id': 'req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:52.722128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6434a79419c48be935597b67ea2185f', 'request_id': 'req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:52.738860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] The token cache is being invalidate because project e6434a79419c48be935597b67ea2185f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:54:52.739155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:52.739865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7c274c9-2d9f-4ae2-9783-a9ab21550f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:54:52.741872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1079/2152] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:54:52 2022] DELETE /identity/v3/projects/e6434a79419c48be935597b67ea2185f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:52.746822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbac80-b085-494c-817f-6f058d4c106f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:52.747296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbac80-b085-494c-817f-6f058d4c106f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:52.747431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbac80-b085-494c-817f-6f058d4c106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:52.769943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-77fbac80-b085-494c-817f-6f058d4c106f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:52.771378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-77fbac80-b085-494c-817f-6f058d4c106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:52.861610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1074/2153] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:52.870991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3f9d-b017-42fb-bd71-62753bfaba07 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:52.871340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3f9d-b017-42fb-bd71-62753bfaba07 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:52.871589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3f9d-b017-42fb-bd71-62753bfaba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:52.898235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b87a3f9d-b017-42fb-bd71-62753bfaba07 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:52.899554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b87a3f9d-b017-42fb-bd71-62753bfaba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:52.909257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1080/2154] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:52.915095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbac80-b085-494c-817f-6f058d4c106f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:52.925619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbac80-b085-494c-817f-6f058d4c106f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:52.930531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:52.931179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:52.931634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:52.931933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:52.932597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:52.932903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:52.934559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:52.948368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1075/2155] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:52.959680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a3f9d-b017-42fb-bd71-62753bfaba07 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:52.969491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a3f9d-b017-42fb-bd71-62753bfaba07 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:52.976079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:52.976804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:52.977149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:52.977491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:52.978196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:52.980406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.084965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1081/2156] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:52 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:53.088993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:53.100915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a2bd6-709a-462e-907f-159f82b5adb6 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:53.163878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:53.164497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.164779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.165056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.165707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:53.167682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.283643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1076/2157] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:53 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:53.287717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:53.299923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61f81-e65f-4751-9c31-41aac4f689da admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:53.305231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:53.305906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.306210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.306816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.307347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:53.309050 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.323845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1082/2158] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:53.327277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:53.338364 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dcee5-4c7d-4b02-976a-c7b658d0a5de admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:53.343068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c51747-d4b2-4792-a762-d5ff7b6443fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:53.343910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51747-d4b2-4792-a762-d5ff7b6443fa admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.344367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51747-d4b2-4792-a762-d5ff7b6443fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.344904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51747-d4b2-4792-a762-d5ff7b6443fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.346320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c51747-d4b2-4792-a762-d5ff7b6443fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:53.348362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c51747-d4b2-4792-a762-d5ff7b6443fa admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.361197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1077/2159] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:53.365666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:53.383287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59675e-0443-4296-b6f6-66ba70ff2509 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:53.387264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:53.388081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.388430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.388781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] PATH_INFO: `/v3/projects/93fd94401c6c439cb7ef60ead804809d/users/80940531e10d4594abd3dff0dc87d6c6/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.405600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fd94401c6c439cb7ef60ead804809d, user_id=80940531e10d4594abd3dff0dc87d6c6, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:53.409040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.499983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1083/2160] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:53 2022] PUT /identity/v3/projects/93fd94401c6c439cb7ef60ead804809d/users/80940531e10d4594abd3dff0dc87d6c6/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:53.511423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4924373-f109-4af0-98d0-254fd7f885c4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.511716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4924373-f109-4af0-98d0-254fd7f885c4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.511995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4924373-f109-4af0-98d0-254fd7f885c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.541324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a4924373-f109-4af0-98d0-254fd7f885c4 None None] MFA Rules not processed for user `80940531e10d4594abd3dff0dc87d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:53.542546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a4924373-f109-4af0-98d0-254fd7f885c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:53.604743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:53.614437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1078/2161] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:54:53.619149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:53.660362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:53.683802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cc8c8-83f3-4ebe-9230-76a48e0ca6e1 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:53.688728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:53.689833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.690114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.690388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.691019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:53.693032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.798862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1084/2162] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:54:53 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:53.803390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4924373-f109-4af0-98d0-254fd7f885c4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:53.814961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4924373-f109-4af0-98d0-254fd7f885c4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:53.876262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:53.877478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.877765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.878041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.878685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:53.880676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.951740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1079/2163] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:53 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:53.956005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:53.967884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3fbd1-305d-4267-bd91-d3ed38b7ae75 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:53.972902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:53.973518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:53.973804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:53.974081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:53.974742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:53.976547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:53.988779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1085/2164] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:54.000548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:54.011755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a20272-71eb-4ff9-bf32-dceb275b389d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:54.016613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:54.017674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:54.017955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:54.018229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] PATH_INFO: `/v3/projects/a85f1b69f9604e7983cd1e4046ef2819/users/4d37a5b72d514ec19be577c34bdf003f/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:54.033773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85f1b69f9604e7983cd1e4046ef2819, user_id=4d37a5b72d514ec19be577c34bdf003f, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:54.040023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:54.119738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1080/2165] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:53 2022] PUT /identity/v3/projects/a85f1b69f9604e7983cd1e4046ef2819/users/4d37a5b72d514ec19be577c34bdf003f/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:54.123521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:54.134551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521352df-5ef2-47c5-b6f4-1749cadd0e56 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:54.204522 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171b2ba-6d47-4d66-855c-c643b0d06c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:54.205277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171b2ba-6d47-4d66-855c-c643b0d06c16 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:54.205636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171b2ba-6d47-4d66-855c-c643b0d06c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:54.205994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171b2ba-6d47-4d66-855c-c643b0d06c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:54.206931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171b2ba-6d47-4d66-855c-c643b0d06c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:54.209005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171b2ba-6d47-4d66-855c-c643b0d06c16 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:54.224659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1086/2166] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:54.226576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:54.249890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190457b5-cae3-4f38-9133-f373b010fdd2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:54.255041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:54.255755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:54.256037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:54.256548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] PATH_INFO: `/v3/projects/a85f1b69f9604e7983cd1e4046ef2819/users/4d37a5b72d514ec19be577c34bdf003f/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:54.258571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85f1b69f9604e7983cd1e4046ef2819, user_id=4d37a5b72d514ec19be577c34bdf003f, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:54.261267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:54.277343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1081/2167] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:54:54 2022] PUT /identity/v3/projects/a85f1b69f9604e7983cd1e4046ef2819/users/4d37a5b72d514ec19be577c34bdf003f/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:54.289430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:54.289971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:54.290092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:54.320009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] MFA Rules not processed for user `4d37a5b72d514ec19be577c34bdf003f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:54.321199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:54.399158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1087/2168] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:54:54.412272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:54.414480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:54.482353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1e96-728a-4e74-83a4-26ee449a2927 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:54.486595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:54.487203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:54.487510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:54.487781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:54.499287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:54.500762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:54.511340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1082/2169] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:54:54.664036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:54.665477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:54.678606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70024216-14b5-4bb1-b032-5bba3527395b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:54.682418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12090b-1c3b-4301-9ab3-39d5e201bb13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:54.683030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12090b-1c3b-4301-9ab3-39d5e201bb13 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:54.683314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12090b-1c3b-4301-9ab3-39d5e201bb13 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:54.683621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12090b-1c3b-4301-9ab3-39d5e201bb13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:54.716283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:54.745155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12090b-1c3b-4301-9ab3-39d5e201bb13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:54.746791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12090b-1c3b-4301-9ab3-39d5e201bb13 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:54.756228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1088/2170] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:00.280719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:00.333353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:00.367166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f87b-d181-44c4-8123-7fe095fcdc6d service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:00.367166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:00.367166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:00.367166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:00.367533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] PATH_INFO: `/v3/users/80940531e10d4594abd3dff0dc87d6c6` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:00.367533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80940531e10d4594abd3dff0dc87d6c6)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:00.368242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:00.583033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80940531e10d4594abd3dff0dc87d6c6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:00.583991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80940531e10d4594abd3dff0dc87d6c6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:00.591288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80940531e10d4594abd3dff0dc87d6c6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:00.592060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80940531e10d4594abd3dff0dc87d6c6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:00.605705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80940531e10d4594abd3dff0dc87d6c6'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:00.728234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1083/2171] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:00 2022] DELETE /identity/v3/users/80940531e10d4594abd3dff0dc87d6c6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:00.733769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:00.734332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:00.734332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:00.756591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:00.758140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:00.861119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1089/2172] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:00.862310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:00.862310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:00.900082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e0b0-62b9-4c81-9116-117da927b766 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:00.903945 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:00.913160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:00.913160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:00.913160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:00.915938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:00.917404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:00.929144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1084/2173] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:01.507764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:01.509245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:01.527157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6a38-77dd-4f01-800f-4e77ff8b0bc7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:01.532552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:01.533378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:01.533507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:01.533746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] PATH_INFO: `/v3/projects/93fd94401c6c439cb7ef60ead804809d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:01.534917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fd94401c6c439cb7ef60ead804809d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:01.536960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:01.649324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fd94401c6c439cb7ef60ead804809d', 'request_id': 'req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:01.655787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fd94401c6c439cb7ef60ead804809d', 'request_id': 'req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:01.756074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fd94401c6c439cb7ef60ead804809d', 'request_id': 'req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:01.768572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] The token cache is being invalidate because project 93fd94401c6c439cb7ef60ead804809d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:01.768865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:01.769519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:01.776798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1090/2174] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:01 2022] DELETE /identity/v3/projects/93fd94401c6c439cb7ef60ead804809d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:01.780981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:01.795991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdda05-9588-4d6f-aec6-8b9420b344f8 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:01.855084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:01.855748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:01.856031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:01.856307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] PATH_INFO: `/v3/users/4d37a5b72d514ec19be577c34bdf003f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:01.857464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d37a5b72d514ec19be577c34bdf003f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:01.859475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:01.873687 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:02.080383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d37a5b72d514ec19be577c34bdf003f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:02.081105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d37a5b72d514ec19be577c34bdf003f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:02.088632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d37a5b72d514ec19be577c34bdf003f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:02.089323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d37a5b72d514ec19be577c34bdf003f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:02.102774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d37a5b72d514ec19be577c34bdf003f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:02.190478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1085/2175] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:01 2022] DELETE /identity/v3/users/4d37a5b72d514ec19be577c34bdf003f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:02.730125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:02.731589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:02.745418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd228c0-006d-4cbd-92d0-1f70b0927ec8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:02.806359 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:02.823736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:02.823736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:02.823736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:02.823736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] PATH_INFO: `/v3/projects/a85f1b69f9604e7983cd1e4046ef2819` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:02.828252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85f1b69f9604e7983cd1e4046ef2819)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:02.828252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:02.830726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:02.832268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:02.846744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba29daf-8614-4b2c-ac15-78a625efea34 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:02.851972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:02.852845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:02.853144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:02.853529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] PATH_INFO: `/v3/users/5ebfa36ddb0f4e299ce66c68287f1f3f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:02.855333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebfa36ddb0f4e299ce66c68287f1f3f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:02.857576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:03.117376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85f1b69f9604e7983cd1e4046ef2819', 'request_id': 'req-82d95164-2414-4249-82f1-30363f1d46bd'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.122559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebfa36ddb0f4e299ce66c68287f1f3f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.123299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebfa36ddb0f4e299ce66c68287f1f3f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.123496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85f1b69f9604e7983cd1e4046ef2819', 'request_id': 'req-82d95164-2414-4249-82f1-30363f1d46bd'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.131723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebfa36ddb0f4e299ce66c68287f1f3f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.133329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebfa36ddb0f4e299ce66c68287f1f3f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.147093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-729e0443-f3fe-4eab-a97a-be7058807d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebfa36ddb0f4e299ce66c68287f1f3f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.190580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85f1b69f9604e7983cd1e4046ef2819', 'request_id': 'req-82d95164-2414-4249-82f1-30363f1d46bd'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.202728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] The token cache is being invalidate because project a85f1b69f9604e7983cd1e4046ef2819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:03.203020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.203689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-82d95164-2414-4249-82f1-30363f1d46bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:03.205218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1091/2176] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:02 2022] DELETE /identity/v3/projects/a85f1b69f9604e7983cd1e4046ef2819 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:03.210115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d759b0-1cb2-4c76-a5e5-895a3607b319 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:03.210431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d759b0-1cb2-4c76-a5e5-895a3607b319 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:03.210814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d759b0-1cb2-4c76-a5e5-895a3607b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:03.231328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-83d759b0-1cb2-4c76-a5e5-895a3607b319 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:03.232546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-83d759b0-1cb2-4c76-a5e5-895a3607b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:03.265740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1086/2177] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:02 2022] DELETE /identity/v3/users/5ebfa36ddb0f4e299ce66c68287f1f3f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:03.270618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:03.271014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:03.271403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:03.292572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:03.294135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:03.305966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1092/2178] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:03.313732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fb4c0-a552-43b2-9fc2-62fc70b7c988 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:03.314024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fb4c0-a552-43b2-9fc2-62fc70b7c988 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:03.314484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fb4c0-a552-43b2-9fc2-62fc70b7c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:03.335692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7e9fb4c0-a552-43b2-9fc2-62fc70b7c988 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:03.336913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7e9fb4c0-a552-43b2-9fc2-62fc70b7c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:03.380939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1087/2179] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:03.391020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:03.393663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:03.402311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:03.456188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1093/2180] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:03.464153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fb4c0-a552-43b2-9fc2-62fc70b7c988 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:03.488677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fb4c0-a552-43b2-9fc2-62fc70b7c988 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:03.509817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:03.510615 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:03.511035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:03.511327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:03.512101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:03.512341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:03.515035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:03.540756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06774c0d-2bb4-4b5c-a321-7092a4123985 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:03.549159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:03.550029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:03.550461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:03.550898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:03.551185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1094/2181] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:55:03.556892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:03.566601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:03.570038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:03.585658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341162b7-3976-45f5-b05c-fbae9b2d3836 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:03.588949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1088/2182] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:03.601268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:03.603699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:03.604014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:03.604301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:03.605023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:03.607650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:03.623730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:03.711219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1095/2183] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:03 2022] POST /identity/v3/projects => generated 393 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:03.716160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:03.729169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817cb15-9dbe-46f5-83fe-824271e692f3 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:03.814249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:03.814901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:03.815181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:03.815486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:03.816169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:03.818361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:03.973809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1089/2184] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:03 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:03.975423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:03.991382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7f2ef-634a-4172-a8fe-e3208954fedf admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:03.999661 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.004096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.004096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.004096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.004096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.004895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.017574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1096/2185] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:04.021365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.032897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96b7ca-c1c1-4259-a569-9b085f854e97 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.039031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a1003-f32f-4199-8db4-bd6c07438297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.039852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1003-f32f-4199-8db4-bd6c07438297 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.040234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1003-f32f-4199-8db4-bd6c07438297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.040618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1003-f32f-4199-8db4-bd6c07438297 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.041383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a1003-f32f-4199-8db4-bd6c07438297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.043087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a1003-f32f-4199-8db4-bd6c07438297 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.058845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1090/2186] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:04.064704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.076499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23b81-c989-436b-b8c0-b3552487c87e admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.081709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.082386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.082674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.082955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] PATH_INFO: `/v3/projects/2cc2fd69bd9d4898b2830ab6bd9a1146/users/1d4c460615f646b3afc4c0ea31ba00a2/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.099656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc2fd69bd9d4898b2830ab6bd9a1146, user_id=1d4c460615f646b3afc4c0ea31ba00a2, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.105600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.238653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1097/2187] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:04 2022] PUT /identity/v3/projects/2cc2fd69bd9d4898b2830ab6bd9a1146/users/1d4c460615f646b3afc4c0ea31ba00a2/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:04.249367 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.249669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.249969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.279836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] MFA Rules not processed for user `1d4c460615f646b3afc4c0ea31ba00a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:04.281222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:04.396124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1091/2188] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:04.401163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.471181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.472713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:04.504608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a472-2406-4e85-b2d3-1daa67580483 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.513745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.515946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.516283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.516708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.517730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.520004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.521019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:04.591818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd676-aaed-43cf-80bc-fc734d8a027f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.600363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.601793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.602321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.603126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] PATH_INFO: `/v3/projects/72ad55ae3f71435eadffb17e16280e3a` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.606097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ad55ae3f71435eadffb17e16280e3a)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.611568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.645238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1098/2189] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:04 2022] POST /identity/v3/projects => generated 391 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:04.652496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.734698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6637-be83-4884-ac63-f1282407bd63 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.746526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ad55ae3f71435eadffb17e16280e3a', 'request_id': 'req-26f9091c-89f5-4b93-a701-13b208c4d96d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:04.756351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ad55ae3f71435eadffb17e16280e3a', 'request_id': 'req-26f9091c-89f5-4b93-a701-13b208c4d96d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:04.790595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:04.800614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.801235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.801520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.801797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.802436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.804438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.847752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ad55ae3f71435eadffb17e16280e3a', 'request_id': 'req-26f9091c-89f5-4b93-a701-13b208c4d96d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:04.859458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] The token cache is being invalidate because project 72ad55ae3f71435eadffb17e16280e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:04.861875 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:04.862562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:04.864261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1092/2190] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:04 2022] DELETE /identity/v3/projects/72ad55ae3f71435eadffb17e16280e3a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:04.868077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.869549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:04.886009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9091c-89f5-4b93-a701-13b208c4d96d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.895065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.896624 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.897207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.898685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] PATH_INFO: `/v3/users/4205e44a228949fea1f08509aa82a75c` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.899056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1099/2191] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:04 2022] POST /identity/v3/users => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:04.900094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.900343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4205e44a228949fea1f08509aa82a75c)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.904243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:04.912699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.917423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270e20-3cb4-42b4-937a-29f00feb836c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.929622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.930510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.930791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.931128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.931915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.933491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:04.947401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1100/2192] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:04.952298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:04.963831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa7b38-7003-4a95-a955-d6fa972cba8f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:04.969367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:04.970719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:04.970997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:04.971281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] PATH_INFO: `/v3/projects/ff8966efd86b4ec9875efd23a8cea6ee/users/b7b2cc6300b84d20a7131dd593ef08d3/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:04.990669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8966efd86b4ec9875efd23a8cea6ee, user_id=b7b2cc6300b84d20a7131dd593ef08d3, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:04.993550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:05.100244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1101/2193] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:04 2022] PUT /identity/v3/projects/ff8966efd86b4ec9875efd23a8cea6ee/users/b7b2cc6300b84d20a7131dd593ef08d3/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:05.104257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:05.139721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4205e44a228949fea1f08509aa82a75c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:05.140721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4205e44a228949fea1f08509aa82a75c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:05.149300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4205e44a228949fea1f08509aa82a75c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:05.149993 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4205e44a228949fea1f08509aa82a75c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:05.162694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-92ecf429-ed0c-4a8e-b7e0-2d292c6906fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4205e44a228949fea1f08509aa82a75c'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:05.169833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459ed8c-3d9c-4248-8e20-d889c4171a71 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:05.175014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:05.179143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:05.179143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:05.179143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:05.179143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:05.179143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:05.189356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1102/2194] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:05.193165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:05.194881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:05.210072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32f972-853f-4523-b1d7-fdfbda140c99 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:05.215116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:05.215957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:05.216335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:05.216715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] PATH_INFO: `/v3/projects/ff8966efd86b4ec9875efd23a8cea6ee/users/b7b2cc6300b84d20a7131dd593ef08d3/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:05.220737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8966efd86b4ec9875efd23a8cea6ee, user_id=b7b2cc6300b84d20a7131dd593ef08d3, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:05.225562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:05.230266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1093/2195] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:04 2022] DELETE /identity/v3/users/4205e44a228949fea1f08509aa82a75c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:05.243844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1103/2196] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:05 2022] PUT /identity/v3/projects/ff8966efd86b4ec9875efd23a8cea6ee/users/b7b2cc6300b84d20a7131dd593ef08d3/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:05.263444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fd694-be73-4cd3-803d-458ea38a36f6 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:05.265556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fd694-be73-4cd3-803d-458ea38a36f6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:05.265556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fd694-be73-4cd3-803d-458ea38a36f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:05.317227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-908fd694-be73-4cd3-803d-458ea38a36f6 None None] MFA Rules not processed for user `b7b2cc6300b84d20a7131dd593ef08d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:05.319383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-908fd694-be73-4cd3-803d-458ea38a36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:05.403388 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:05.415805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1094/2197] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:05.426920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:05.428690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:05.492774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135be0b-1d3a-4380-a3e1-46642180ca8b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:05.496538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:05.503130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:05.503130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:05.503130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:05.511944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:05.513648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:05.527282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1104/2198] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:05.588873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fd694-be73-4cd3-803d-458ea38a36f6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:05.599430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fd694-be73-4cd3-803d-458ea38a36f6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:05.603351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:05.604051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:05.604369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:05.604646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:05.606772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:05.671340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:05.672904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:05.682390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1095/2199] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:05.767636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:05.768719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:05.803125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:05.857731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d925-a449-4c22-956b-2aee70670384 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:05.862423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:05.863168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:05.863494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:05.863761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] PATH_INFO: `/v3/projects/d5ae5f3123714a47b9aa1168652263d1` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:05.864901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ae5f3123714a47b9aa1168652263d1)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:05.866846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:05.979805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ae5f3123714a47b9aa1168652263d1', 'request_id': 'req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:05.985063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ae5f3123714a47b9aa1168652263d1', 'request_id': 'req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.103894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ae5f3123714a47b9aa1168652263d1', 'request_id': 'req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.120726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] The token cache is being invalidate because project d5ae5f3123714a47b9aa1168652263d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:06.120726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.120726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.124494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1105/2200] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:05 2022] DELETE /identity/v3/projects/d5ae5f3123714a47b9aa1168652263d1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:06.127432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:06.141943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cfa59-f0bc-4585-b125-ddca1793eec6 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:06.217039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:06.217701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:06.218175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:06.218454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] PATH_INFO: `/v3/users/68c897f98af842b985f2cd392147b190` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:06.220506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c897f98af842b985f2cd392147b190)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:06.227881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:06.427542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:06.430468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c897f98af842b985f2cd392147b190'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.431139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c897f98af842b985f2cd392147b190'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.438898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c897f98af842b985f2cd392147b190'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.444240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c897f98af842b985f2cd392147b190'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.459306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-5273f98e-b421-46e8-9653-497702dd985b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c897f98af842b985f2cd392147b190'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:06.568460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1096/2201] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:06 2022] DELETE /identity/v3/users/68c897f98af842b985f2cd392147b190 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:07.106802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:07.106802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:07.120144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a9a8-ba59-49b3-a0b1-87e8bca89fcb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:07.192416 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:07.193090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:07.193375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:07.193651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] PATH_INFO: `/v3/projects/d0cdf77914d14cea88a05d16a5cbc6aa` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:07.194837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cdf77914d14cea88a05d16a5cbc6aa)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:07.196780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:07.358146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cdf77914d14cea88a05d16a5cbc6aa', 'request_id': 'req-5b4a9c90-2744-4a10-961a-eac4861960f3'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:07.366365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cdf77914d14cea88a05d16a5cbc6aa', 'request_id': 'req-5b4a9c90-2744-4a10-961a-eac4861960f3'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:07.368426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:07.436831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cdf77914d14cea88a05d16a5cbc6aa', 'request_id': 'req-5b4a9c90-2744-4a10-961a-eac4861960f3'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:07.450598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] The token cache is being invalidate because project d0cdf77914d14cea88a05d16a5cbc6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:07.450901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:07.451641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5b4a9c90-2744-4a10-961a-eac4861960f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:07.453217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1106/2202] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:07 2022] DELETE /identity/v3/projects/d0cdf77914d14cea88a05d16a5cbc6aa => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:07.458350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a7ea5-9130-4190-afd9-2f22fcb88a2e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:07.458917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a7ea5-9130-4190-afd9-2f22fcb88a2e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:07.458917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a7ea5-9130-4190-afd9-2f22fcb88a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:07.481411 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e70a7ea5-9130-4190-afd9-2f22fcb88a2e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:07.482641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e70a7ea5-9130-4190-afd9-2f22fcb88a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:07.556720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1097/2203] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:07.565348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be988-bf61-42cc-8225-f4e3cc324bab None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:07.565664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be988-bf61-42cc-8225-f4e3cc324bab None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:07.566122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be988-bf61-42cc-8225-f4e3cc324bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:07.587760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-669be988-bf61-42cc-8225-f4e3cc324bab None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:07.589200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-669be988-bf61-42cc-8225-f4e3cc324bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:07.597694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1107/2204] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:07.602094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a7ea5-9130-4190-afd9-2f22fcb88a2e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:07.613007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a7ea5-9130-4190-afd9-2f22fcb88a2e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:07.618048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:07.618634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:07.618912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:07.619185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:07.619877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:07.623698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:07.623698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:07.636160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1098/2205] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:07.640269 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be988-bf61-42cc-8225-f4e3cc324bab None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:07.651187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be988-bf61-42cc-8225-f4e3cc324bab None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:07.658512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:07.662153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:07.662451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:07.662778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:07.663477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:07.665518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:07.841287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1108/2206] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:07 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:07.842427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:07.858802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a9a6-34c3-4b0c-88a9-b36c0406de2c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:07.917741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:07.918268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:07.918551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:07.918827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:07.919485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:07.921510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:08.051573 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1099/2207] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:07 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:08.052708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:08.064182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149058c2-7653-42df-aaa3-f5d453fe6496 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:08.071443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:08.072063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:08.072347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:08.072623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:08.073278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:08.074926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:08.086153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1109/2208] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:08.093813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:08.105119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b43981-8106-42e8-84d4-143365a8e6aa admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:08.110163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421c57-633a-426c-be95-22afa5933c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:08.110776 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421c57-633a-426c-be95-22afa5933c13 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:08.111060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421c57-633a-426c-be95-22afa5933c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:08.111331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421c57-633a-426c-be95-22afa5933c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:08.112197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01421c57-633a-426c-be95-22afa5933c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:08.114094 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01421c57-633a-426c-be95-22afa5933c13 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:08.127247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1100/2209] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:08.133282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:08.150936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354d953-286e-4c45-9dfb-d289f58b0de3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:08.157769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:08.158463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:08.158752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:08.159036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] PATH_INFO: `/v3/projects/0aae6cd87bef4ea7adc2db597987812d/users/7863fada3bd44490b7a859c5d1431175/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:08.181817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aae6cd87bef4ea7adc2db597987812d, user_id=7863fada3bd44490b7a859c5d1431175, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:08.184645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:08.289490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1110/2210] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:08 2022] PUT /identity/v3/projects/0aae6cd87bef4ea7adc2db597987812d/users/7863fada3bd44490b7a859c5d1431175/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:08.299995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d384-4150-4ad7-a4a8-4af465f21404 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:08.300283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d384-4150-4ad7-a4a8-4af465f21404 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:08.300558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d384-4150-4ad7-a4a8-4af465f21404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:08.329348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-4af0d384-4150-4ad7-a4a8-4af465f21404 None None] MFA Rules not processed for user `7863fada3bd44490b7a859c5d1431175`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:08.330598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4af0d384-4150-4ad7-a4a8-4af465f21404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:08.349033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:08.404707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1101/2211] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:08.417121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:08.418825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:08.502613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23861ca6-477f-4622-bb3b-393b9db5c083 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:08.506497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6852d-545e-44f3-a96f-0824877cee66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:08.507176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6852d-545e-44f3-a96f-0824877cee66 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:08.507496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6852d-545e-44f3-a96f-0824877cee66 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:08.507779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6852d-545e-44f3-a96f-0824877cee66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:08.518093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6852d-545e-44f3-a96f-0824877cee66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:08.519655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6852d-545e-44f3-a96f-0824877cee66 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:08.529656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1111/2212] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:08.556575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d384-4150-4ad7-a4a8-4af465f21404 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:08.657739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d384-4150-4ad7-a4a8-4af465f21404 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:08.662471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:08.663115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:08.663483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:08.663762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] PATH_INFO: `/v3/users/7863fada3bd44490b7a859c5d1431175` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:08.664972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7863fada3bd44490b7a859c5d1431175)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:08.666893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:08.929870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7863fada3bd44490b7a859c5d1431175'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:08.930873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7863fada3bd44490b7a859c5d1431175'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:08.942271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7863fada3bd44490b7a859c5d1431175'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:08.943440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7863fada3bd44490b7a859c5d1431175'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:08.968650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7863fada3bd44490b7a859c5d1431175'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:09.070208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1102/2213] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:08 2022] DELETE /identity/v3/users/7863fada3bd44490b7a859c5d1431175 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:09.080772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:09.081610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:09.081941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:09.118091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:09.122428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:09.236673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1112/2214] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:09.247202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:09.248768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:09.301884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:09.321301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca68cc-41e8-4f80-a44e-2f3ff289da71 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:09.325200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26ffcf-715f-4027-bb62-02f4c370da0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:09.325652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26ffcf-715f-4027-bb62-02f4c370da0b service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:09.325936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26ffcf-715f-4027-bb62-02f4c370da0b service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:09.326209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26ffcf-715f-4027-bb62-02f4c370da0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:09.336463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26ffcf-715f-4027-bb62-02f4c370da0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:09.337919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26ffcf-715f-4027-bb62-02f4c370da0b service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:09.350036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1103/2215] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:10.098558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:10.100670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:10.119856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc63daf-a9f3-46ef-a2de-f32667d6d291 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:10.125879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:10.126543 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.126824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.127195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] PATH_INFO: `/v3/projects/0aae6cd87bef4ea7adc2db597987812d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.128651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aae6cd87bef4ea7adc2db597987812d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:10.131353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:10.196297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bba1e-fb43-4a40-bca5-3a28ffed8fca None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.196886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bba1e-fb43-4a40-bca5-3a28ffed8fca None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.196982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bba1e-fb43-4a40-bca5-3a28ffed8fca None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.198410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1104/2216] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:55:10.201258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:10.225521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.225817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.226150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.253426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] MFA Rules not processed for user `4ee628c7459142eca1ebb60e1acfbeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:10.253426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:10.336739 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1105/2217] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:10.351686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:10.354102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:10.394399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57419ffc-2520-4aea-8b21-66de8b6315b3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:10.395472 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aae6cd87bef4ea7adc2db597987812d', 'request_id': 'req-f74d91e1-31ba-440d-8911-c07a98840fd8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.424762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aae6cd87bef4ea7adc2db597987812d', 'request_id': 'req-f74d91e1-31ba-440d-8911-c07a98840fd8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.495460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:10.495460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.495460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.495955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.508507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:10.510521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:10.524402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1106/2218] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:10.529229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:10.532809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:10.564673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aae6cd87bef4ea7adc2db597987812d', 'request_id': 'req-f74d91e1-31ba-440d-8911-c07a98840fd8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.594391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] The token cache is being invalidate because project 0aae6cd87bef4ea7adc2db597987812d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:10.594907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.596283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f74d91e1-31ba-440d-8911-c07a98840fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.600762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1113/2219] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:10 2022] DELETE /identity/v3/projects/0aae6cd87bef4ea7adc2db597987812d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:10.606140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9331a-91d6-4c6c-a870-d828dbdd9468 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.607582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9331a-91d6-4c6c-a870-d828dbdd9468 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.608100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9331a-91d6-4c6c-a870-d828dbdd9468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.625814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e9639-d263-4079-b049-7a776b8b80cb service placement] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:10.631205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:10.631886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.632173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.633602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] PATH_INFO: `/v3/users/c453403ed2ea417db3c8697450cd1b78` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.633602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c453403ed2ea417db3c8697450cd1b78)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:10.635685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:10.639044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-aee9331a-91d6-4c6c-a870-d828dbdd9468 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:10.641743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:10.646646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-aee9331a-91d6-4c6c-a870-d828dbdd9468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:10.659992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1114/2220] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:10.669467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c667dc-c5fd-450b-82db-786089f11103 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.669772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c667dc-c5fd-450b-82db-786089f11103 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.670052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c667dc-c5fd-450b-82db-786089f11103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.706675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-93c667dc-c5fd-450b-82db-786089f11103 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:10.708066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-93c667dc-c5fd-450b-82db-786089f11103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:10.719935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1115/2221] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:10.724950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c667dc-c5fd-450b-82db-786089f11103 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:10.736032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c667dc-c5fd-450b-82db-786089f11103 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:10.741936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:10.742910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.743172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.743498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.744211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:10.744471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:10.746181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:10.759461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1116/2222] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:55:10.763785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:10.774839 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebfef5-4bbd-49b9-b4a2-590b539e8d70 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:10.783544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:10.784175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:10.784544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:10.784885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:10.785581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:10.787763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:10.910871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1117/2223] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:10 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:10.912444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:10.925416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c453403ed2ea417db3c8697450cd1b78'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.926571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c453403ed2ea417db3c8697450cd1b78'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.942037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c453403ed2ea417db3c8697450cd1b78'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.942457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c453403ed2ea417db3c8697450cd1b78'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.962243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a0d77738-5e65-4a2d-8287-ff9a575dc3ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c453403ed2ea417db3c8697450cd1b78'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:10.995445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78085237-26d3-4d10-8785-cd9d4a973a29 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:11.001128 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:11.002015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.002367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.002720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.003493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:11.005676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:11.137024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1107/2224] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:10 2022] DELETE /identity/v3/users/c453403ed2ea417db3c8697450cd1b78 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:11.142996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.143320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.143600 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.163954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:11.165346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:11.181031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1118/2225] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:10 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:11.186102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:11.192542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:11.208540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e0af0-c8ae-47fc-8f1f-ab724caa601c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:11.253450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1108/2226] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:11.264670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:11.266314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:11.287928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:11.287928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.287928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.287928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.288468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:11.288468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:11.303484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1119/2227] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:11.304753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:11.306535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:11.323414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe61d-09a2-4e53-bc0f-865600a2a429 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:11.329455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:11.330340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.330905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.331334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] PATH_INFO: `/v3/users/9d08758b38274e30811b86917815539f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.332740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d08758b38274e30811b86917815539f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:11.334772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:11.405946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dd104-0352-47be-8ee3-257c89ef517e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:11.411218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:11.411878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.412175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.412931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.425436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:11.427833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:11.440102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1109/2228] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:11.441054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:11.452214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9b3e0-e5a4-46f0-9968-b9f30c9ab2a7 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:11.457611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:11.458349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.458515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.458794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.459668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:11.462225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:11.477956 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1110/2229] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:11.484101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:11.499167 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805ffa-2d47-4091-ada0-cb258c24894e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:11.510454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6afa-5e8c-4c18-a5a4-7a92218f360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:11.528240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6afa-5e8c-4c18-a5a4-7a92218f360d admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.528532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6afa-5e8c-4c18-a5a4-7a92218f360d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.528807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6afa-5e8c-4c18-a5a4-7a92218f360d admin admin] PATH_INFO: `/v3/projects/a616fee258c14f1289fb10ecc7354067/users/24bcdddbaba14098b3c12bbc679f988d/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.551230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:11.555802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6afa-5e8c-4c18-a5a4-7a92218f360d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a616fee258c14f1289fb10ecc7354067, user_id=24bcdddbaba14098b3c12bbc679f988d, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:11.558691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6afa-5e8c-4c18-a5a4-7a92218f360d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:11.690495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1111/2230] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:11 2022] PUT /identity/v3/projects/a616fee258c14f1289fb10ecc7354067/users/24bcdddbaba14098b3c12bbc679f988d/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:11.691884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.692179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.692455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.693292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d08758b38274e30811b86917815539f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:11.703287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d08758b38274e30811b86917815539f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:11.704184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d08758b38274e30811b86917815539f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:11.722029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d08758b38274e30811b86917815539f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:11.728846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] MFA Rules not processed for user `24bcdddbaba14098b3c12bbc679f988d`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:11.730193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:11.826246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1112/2231] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:11.839474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:11.841476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:11.851707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d08758b38274e30811b86917815539f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:11.851707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1120/2232] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:11 2022] DELETE /identity/v3/users/9d08758b38274e30811b86917815539f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:11.922842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec80dd-2678-4958-a0e6-9b6608325a0c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:11.979811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:11.980478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:11.980757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:11.981032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:11.983074 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:12.050404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:12.050404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:12.065749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:12.067105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:12.083425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1113/2233] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:12.170689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:12.187392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e998-d646-4b20-9f44-c2984c279289 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:12.187392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:12.187392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:12.187392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:12.188044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] PATH_INFO: `/v3/projects/2ae74e9600924c19aafb361e85636135` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:12.188044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae74e9600924c19aafb361e85636135)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:12.188044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:12.358387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae74e9600924c19aafb361e85636135', 'request_id': 'req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.364163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae74e9600924c19aafb361e85636135', 'request_id': 'req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.379099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:12.380649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:12.397269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d309f-50e5-4f09-94b1-61d71d648e89 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:12.474139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:12.475130 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:12.475453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:12.476200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] PATH_INFO: `/v3/projects/ec1c313ab77348b19aa46f161030a2e6` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:12.477139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1c313ab77348b19aa46f161030a2e6)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:12.482955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:12.486145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae74e9600924c19aafb361e85636135', 'request_id': 'req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.504877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] The token cache is being invalidate because project 2ae74e9600924c19aafb361e85636135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:12.505178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.507902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2fb8dd2e-2344-403a-8efd-0e7edb57c6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.513673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1121/2234] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:12 2022] DELETE /identity/v3/projects/2ae74e9600924c19aafb361e85636135 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:12.522094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d59f8-0788-48eb-85d9-272ea49847a7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:12.522979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d59f8-0788-48eb-85d9-272ea49847a7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:12.523445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d59f8-0788-48eb-85d9-272ea49847a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:12.569835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3d3d59f8-0788-48eb-85d9-272ea49847a7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:12.571206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3d3d59f8-0788-48eb-85d9-272ea49847a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:12.581602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1122/2235] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:12.590882 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02916a35-08d8-41e9-a5cd-7281c10b2b8a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:12.591528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02916a35-08d8-41e9-a5cd-7281c10b2b8a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:12.591804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02916a35-08d8-41e9-a5cd-7281c10b2b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:12.619190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-02916a35-08d8-41e9-a5cd-7281c10b2b8a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:12.638774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-02916a35-08d8-41e9-a5cd-7281c10b2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:12.638774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1123/2236] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:12.652659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02916a35-08d8-41e9-a5cd-7281c10b2b8a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:12.669565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02916a35-08d8-41e9-a5cd-7281c10b2b8a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:12.726037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1c313ab77348b19aa46f161030a2e6', 'request_id': 'req-10271d6e-fbc7-4d41-ac72-e9113e4f1929'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.732761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1c313ab77348b19aa46f161030a2e6', 'request_id': 'req-10271d6e-fbc7-4d41-ac72-e9113e4f1929'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.779801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:12.780434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:12.780714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:12.780988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:12.781655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:12.782015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:12.784113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:12.798525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1124/2237] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:12.799456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:12.801243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:12.816025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cbcae-f2eb-49dc-9d7f-9e1086a97c7a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:12.821150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:12.821793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:12.822077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:12.822354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] PATH_INFO: `/v3/users/1d4c460615f646b3afc4c0ea31ba00a2` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:12.823596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4c460615f646b3afc4c0ea31ba00a2)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:12.825709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:12.835949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1c313ab77348b19aa46f161030a2e6', 'request_id': 'req-10271d6e-fbc7-4d41-ac72-e9113e4f1929'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.853763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] The token cache is being invalidate because project ec1c313ab77348b19aa46f161030a2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:12.854087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.855714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:12.859465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1114/2238] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:12 2022] DELETE /identity/v3/projects/ec1c313ab77348b19aa46f161030a2e6 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:12.861681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:12.863564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:12.884081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10271d6e-fbc7-4d41-ac72-e9113e4f1929 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:12.890549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:12.891198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:12.891829 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:12.892590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:12.893359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:12.895899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:13.107186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1115/2239] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:12 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:13.108641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:13.110955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:13.197810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc3dd-53ee-42a6-b74b-c8e56a183fc6 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:13.205187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:13.206116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:13.206572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:13.207079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] PATH_INFO: `/v3/users/b31637cf38484758985e9f148c3eddbb` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:13.208582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31637cf38484758985e9f148c3eddbb)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:13.210928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:13.252147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4c460615f646b3afc4c0ea31ba00a2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.259726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4c460615f646b3afc4c0ea31ba00a2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.260485 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4c460615f646b3afc4c0ea31ba00a2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.290897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4c460615f646b3afc4c0ea31ba00a2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.425468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4c460615f646b3afc4c0ea31ba00a2'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.435925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1125/2240] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:12 2022] DELETE /identity/v3/users/1d4c460615f646b3afc4c0ea31ba00a2 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:13.439923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:13.444278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:13.477269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31637cf38484758985e9f148c3eddbb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.478269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31637cf38484758985e9f148c3eddbb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.486358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31637cf38484758985e9f148c3eddbb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.487201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31637cf38484758985e9f148c3eddbb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.500513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4a862290-8d10-494e-91b4-eb0bfb746673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31637cf38484758985e9f148c3eddbb'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:13.521317 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea296-cfd1-415e-8554-f8868607c12b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:13.526511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:13.527133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:13.527436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:13.527712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:13.528353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:13.530330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:13.545125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:13.618642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1116/2241] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:13 2022] DELETE /identity/v3/users/b31637cf38484758985e9f148c3eddbb => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:13.623142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:13.623451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:13.623730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:13.647685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:13.649202 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:13.649739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1126/2242] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:13 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:13.655448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:13.661559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:13.680780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84999a09-f4c1-4f64-96e0-775d5ada9b2d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:13.722110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1117/2243] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:13.743459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:13.746302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:13.756049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:13.756820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:13.758235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:13.758235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:13.758767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:13.760633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:13.775350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1127/2244] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:13.779409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:13.802769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3947f-2fba-4d2c-b8c7-68338995b741 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:13.817166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:13.817960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:13.818299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:13.818900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:13.820460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:13.822621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:13.855616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1128/2245] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:13.857671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:13.869464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416853ed-8a23-4e7f-ac91-ce946f576533 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:13.875967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccc58d-eec1-4d4d-aac4-1cbd1cb8205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:13.876963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc58d-eec1-4d4d-aac4-1cbd1cb8205a admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:13.877449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc58d-eec1-4d4d-aac4-1cbd1cb8205a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:13.877800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc58d-eec1-4d4d-aac4-1cbd1cb8205a admin admin] PATH_INFO: `/v3/projects/0f90cfe27c5846ca9af5407f2f93584e/users/fbfb82ddf22c4ff6a6b6d4f27588a16b/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:13.893925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e7db-b36b-4cb2-b747-145a3f4e6f0e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:13.899489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:13.899489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:13.899783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:13.900077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:13.904583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccc58d-eec1-4d4d-aac4-1cbd1cb8205a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f90cfe27c5846ca9af5407f2f93584e, user_id=fbfb82ddf22c4ff6a6b6d4f27588a16b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:13.914578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:13.916455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:13.918328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccc58d-eec1-4d4d-aac4-1cbd1cb8205a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:13.929064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1118/2246] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:14.067001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:14.068651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:14.069621 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1129/2247] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:13 2022] PUT /identity/v3/projects/0f90cfe27c5846ca9af5407f2f93584e/users/fbfb82ddf22c4ff6a6b6d4f27588a16b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:14.081236 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.081542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.083635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.096752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7173b-0ba6-450b-8ec6-65122017189d service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:14.159132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] MFA Rules not processed for user `fbfb82ddf22c4ff6a6b6d4f27588a16b`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:14.161667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:14.227189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:14.227860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.228179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.228464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] PATH_INFO: `/v3/projects/b7dd6fbd66534a85b0199acf299bf847` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.229886 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7dd6fbd66534a85b0199acf299bf847)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:14.233435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:14.276748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1130/2248] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:14.305202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:14.306771 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:14.450648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c41353-fdb5-4450-bb3d-e837fd3df997 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:14.457692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7dd6fbd66534a85b0199acf299bf847', 'request_id': 'req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:14.470999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:14.480203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7dd6fbd66534a85b0199acf299bf847', 'request_id': 'req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:14.544182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920236-0156-460a-aa18-4aaee7ca7967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:14.545093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920236-0156-460a-aa18-4aaee7ca7967 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.545582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920236-0156-460a-aa18-4aaee7ca7967 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.545978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920236-0156-460a-aa18-4aaee7ca7967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.573860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7dd6fbd66534a85b0199acf299bf847', 'request_id': 'req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:14.591020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] The token cache is being invalidate because project b7dd6fbd66534a85b0199acf299bf847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:14.591763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:14.592791 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b2b1dbf-f4d5-4bd3-b1fe-35288f100a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:14.595057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1119/2249] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:14 2022] DELETE /identity/v3/projects/b7dd6fbd66534a85b0199acf299bf847 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:14.599940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.600620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.600906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.626488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:14.627648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:14.666730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920236-0156-460a-aa18-4aaee7ca7967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:14.668212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920236-0156-460a-aa18-4aaee7ca7967 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:14.681058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1131/2250] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:14.702295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1120/2251] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:14.711800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34974-fd9b-442a-ae05-780f798750bc None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.712560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34974-fd9b-442a-ae05-780f798750bc None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.713068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34974-fd9b-442a-ae05-780f798750bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.713184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:14.723402 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:14.739141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74b07e-b377-4058-8622-c086ec4248d3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:14.745293 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:14.746296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.746296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.746678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] PATH_INFO: `/v3/projects/2cc2fd69bd9d4898b2830ab6bd9a1146` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.748127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc2fd69bd9d4898b2830ab6bd9a1146)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:14.750321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:14.777526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-10e34974-fd9b-442a-ae05-780f798750bc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:14.780532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-10e34974-fd9b-442a-ae05-780f798750bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:14.792029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1132/2252] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:14.797951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e34974-fd9b-442a-ae05-780f798750bc None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:14.807584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e34974-fd9b-442a-ae05-780f798750bc None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:14.812785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:14.813530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.813813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.814090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.822727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:14.822727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:14.822727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:14.832973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1133/2253] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:14.838163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:14.853157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34c328-f733-438c-af7b-8a898cecc949 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:14.862304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:14.862304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:14.862304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:14.862304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:14.862753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:14.866079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:14.921636 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc2fd69bd9d4898b2830ab6bd9a1146', 'request_id': 'req-24fc373c-f6d2-4ac4-be2d-983705b546d4'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:14.945205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:14.946247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc2fd69bd9d4898b2830ab6bd9a1146', 'request_id': 'req-24fc373c-f6d2-4ac4-be2d-983705b546d4'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.084474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1134/2254] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:14 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:15.088466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:15.145262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc2fd69bd9d4898b2830ab6bd9a1146', 'request_id': 'req-24fc373c-f6d2-4ac4-be2d-983705b546d4'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.161084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] The token cache is being invalidate because project 2cc2fd69bd9d4898b2830ab6bd9a1146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:15.161378 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.162054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.163903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1121/2255] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:14 2022] DELETE /identity/v3/projects/2cc2fd69bd9d4898b2830ab6bd9a1146 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:15.167790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:15.169250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:15.173162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510665b-bfae-414a-886e-2b12e1cfc318 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:15.178403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:15.179337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.179856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.180986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.181178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:15.183182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:15.252362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc373c-f6d2-4ac4-be2d-983705b546d4 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:15.257686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:15.258442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.258815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.259188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] PATH_INFO: `/v3/users/b7b2cc6300b84d20a7131dd593ef08d3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.260496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b2cc6300b84d20a7131dd593ef08d3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:15.262627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:15.335804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1135/2256] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:15 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:15.337000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:15.341602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:15.374917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c7ef7-e8f8-4163-8ad5-f88e6e2e4adf admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:15.381585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:15.382601 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.383055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.383513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.384970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:15.387433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:15.416130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1136/2257] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:15.416130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:15.425683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff01834-0547-4f0c-a789-a2d56df02ab3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:15.431944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9af2c-c86b-4f04-b309-778e1583fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:15.432568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9af2c-c86b-4f04-b309-778e1583fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.433240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9af2c-c86b-4f04-b309-778e1583fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.433240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9af2c-c86b-4f04-b309-778e1583fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.433837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9af2c-c86b-4f04-b309-778e1583fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:15.435525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9af2c-c86b-4f04-b309-778e1583fbf2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:15.460334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1137/2258] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:15.460334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.460334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.460334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.487254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] MFA Rules not processed for user `24bcdddbaba14098b3c12bbc679f988d`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:15.488641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:15.561796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b2cc6300b84d20a7131dd593ef08d3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.563828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b2cc6300b84d20a7131dd593ef08d3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.585980 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b2cc6300b84d20a7131dd593ef08d3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.586855 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b2cc6300b84d20a7131dd593ef08d3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.587385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1138/2259] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:15.588341 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:15.596785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:15.607069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b2cc6300b84d20a7131dd593ef08d3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:15.621373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd636-67b2-4807-88a7-a87841625dcd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:15.629692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d70dfb-c513-4fee-8bd1-e2b4e973c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:15.631085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d70dfb-c513-4fee-8bd1-e2b4e973c570 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.631578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d70dfb-c513-4fee-8bd1-e2b4e973c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.632160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d70dfb-c513-4fee-8bd1-e2b4e973c570 admin admin] PATH_INFO: `/v3/projects/6adb68ea65dd4a76bd23ec5de57ae006/users/ecd13529f31f415f8ac6f08592e8dd3d/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.656048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d70dfb-c513-4fee-8bd1-e2b4e973c570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adb68ea65dd4a76bd23ec5de57ae006, user_id=ecd13529f31f415f8ac6f08592e8dd3d, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:15.657292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d70dfb-c513-4fee-8bd1-e2b4e973c570 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:15.687800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1122/2260] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:15 2022] DELETE /identity/v3/users/b7b2cc6300b84d20a7131dd593ef08d3 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:15.694846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:15.696718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:15.781640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1139/2261] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:15 2022] PUT /identity/v3/projects/6adb68ea65dd4a76bd23ec5de57ae006/users/ecd13529f31f415f8ac6f08592e8dd3d/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:15.798255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251c37e-6546-4da6-9c4c-caae9b006b9e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.798564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251c37e-6546-4da6-9c4c-caae9b006b9e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.798912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251c37e-6546-4da6-9c4c-caae9b006b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.876166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0565cb8-54b7-417c-80ba-9cd727049e8f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:15.883093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e251c37e-6546-4da6-9c4c-caae9b006b9e None None] MFA Rules not processed for user `ecd13529f31f415f8ac6f08592e8dd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:15.884386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e251c37e-6546-4da6-9c4c-caae9b006b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:15.977960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1140/2262] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:15.979092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251c37e-6546-4da6-9c4c-caae9b006b9e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:15.981929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:15.983464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:15.983963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:15.984493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] PATH_INFO: `/v3/users/41b8a21b3d0747c68eda9f991d735772` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:15.986086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b8a21b3d0747c68eda9f991d735772)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:15.988727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:15.998597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251c37e-6546-4da6-9c4c-caae9b006b9e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.007822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.011190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.011190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.011190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.011190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.012471 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:16.133318 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1141/2263] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:15 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:16.140311 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:16.214885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea1d07-0bf7-4e2a-94eb-b05c597da85c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.220405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.221033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.221313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.221616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.222253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.224723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:16.258246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b8a21b3d0747c68eda9f991d735772'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.258972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b8a21b3d0747c68eda9f991d735772'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.265862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b8a21b3d0747c68eda9f991d735772'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.267057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b8a21b3d0747c68eda9f991d735772'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.270770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:16.289619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b8a21b3d0747c68eda9f991d735772'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.339289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1142/2264] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:16 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:16.342381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:16.342381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:16.356452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e3374-f141-456d-b5bc-374faca0624b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.361325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.361951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.362236 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.362515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] PATH_INFO: `/v3/projects/ff8966efd86b4ec9875efd23a8cea6ee` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.363746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8966efd86b4ec9875efd23a8cea6ee)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.365921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:16.388268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1123/2265] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:15 2022] DELETE /identity/v3/users/41b8a21b3d0747c68eda9f991d735772 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:16.388268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:16.390374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:16.479780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3853-7401-4df9-8ded-61fa79935dae admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.487082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.487832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.488412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.488412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.489020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.491451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:16.529908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1124/2266] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:16.531458 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:16.548549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa34472-a274-4e28-8be8-e928557d527f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.555421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8966efd86b4ec9875efd23a8cea6ee', 'request_id': 'req-398702f8-aeba-4f07-940c-6842e422f334'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.568995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8966efd86b4ec9875efd23a8cea6ee', 'request_id': 'req-398702f8-aeba-4f07-940c-6842e422f334'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.620241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.620906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.621394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.621669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] PATH_INFO: `/v3/projects/d719ad54990c47b7acd0182d4b845b7d/users/5fae2ad68a2742be8dfe90683de3b9dc/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.640103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d719ad54990c47b7acd0182d4b845b7d, user_id=5fae2ad68a2742be8dfe90683de3b9dc, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.644257 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:16.648072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:16.684055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8966efd86b4ec9875efd23a8cea6ee', 'request_id': 'req-398702f8-aeba-4f07-940c-6842e422f334'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.699720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] The token cache is being invalidate because project ff8966efd86b4ec9875efd23a8cea6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:16.700247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.701148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-398702f8-aeba-4f07-940c-6842e422f334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:16.703247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1143/2267] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:16 2022] DELETE /identity/v3/projects/ff8966efd86b4ec9875efd23a8cea6ee => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:16.709398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abfa31-9fc2-4c45-9333-ebfe11ba9b7b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.709745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abfa31-9fc2-4c45-9333-ebfe11ba9b7b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.710085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abfa31-9fc2-4c45-9333-ebfe11ba9b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.733008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-33abfa31-9fc2-4c45-9333-ebfe11ba9b7b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:16.734238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-33abfa31-9fc2-4c45-9333-ebfe11ba9b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:16.750574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1144/2268] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:16.752958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b397-080f-4277-a1fc-c5b39d92aa73 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.753246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b397-080f-4277-a1fc-c5b39d92aa73 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.753578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b397-080f-4277-a1fc-c5b39d92aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.774704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0481b397-080f-4277-a1fc-c5b39d92aa73 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:16.777819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0481b397-080f-4277-a1fc-c5b39d92aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:16.789787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1145/2269] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:16.794404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b397-080f-4277-a1fc-c5b39d92aa73 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:16.804734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b397-080f-4277-a1fc-c5b39d92aa73 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.827104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1125/2270] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:16 2022] PUT /identity/v3/projects/d719ad54990c47b7acd0182d4b845b7d/users/5fae2ad68a2742be8dfe90683de3b9dc/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:16.828794 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:16.831511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:16.899338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.900119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.900465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.900991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.901550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:16.902038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.904031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:16.927572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1146/2271] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:16.928770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:16.930509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:16.944600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb8ba-4df8-4c1e-a5d6-444466b33bff admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.954495 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c4446-9434-4fa5-a865-4fdbdb3cc2f9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:16.962064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.963213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.963758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.964062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:16.964443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] PATH_INFO: `/v3/projects/7a536708296847aeb7a88156d077da60` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.964702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:16.964970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:16.965244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:16.966635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a536708296847aeb7a88156d077da60)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.969419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:16.971828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:16.973397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.004291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1147/2272] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:17.005490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.023014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1224b8-79f8-4695-a7c7-53519eff39fe admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.030814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.031447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.031909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.032072 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.032664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.034557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.147739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1148/2273] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:17.147739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.158766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a536708296847aeb7a88156d077da60', 'request_id': 'req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:17.164911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a536708296847aeb7a88156d077da60', 'request_id': 'req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:17.228688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeae29-11ce-4897-b63a-57397262d1b6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.233576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.234249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.234539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.234843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] PATH_INFO: `/v3/projects/d719ad54990c47b7acd0182d4b845b7d/users/5fae2ad68a2742be8dfe90683de3b9dc/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.237573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d719ad54990c47b7acd0182d4b845b7d, user_id=5fae2ad68a2742be8dfe90683de3b9dc, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.240280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.257586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1149/2274] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:17 2022] PUT /identity/v3/projects/d719ad54990c47b7acd0182d4b845b7d/users/5fae2ad68a2742be8dfe90683de3b9dc/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:17.258386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.310080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a536708296847aeb7a88156d077da60', 'request_id': 'req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:17.322297 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] The token cache is being invalidate because project 7a536708296847aeb7a88156d077da60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:17.322588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:17.323254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fc74ba0c-0ec4-4c75-81fd-7b26066cce63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:17.324820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1126/2275] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:16 2022] DELETE /identity/v3/projects/7a536708296847aeb7a88156d077da60 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:17.325859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4ec0-a05e-4cf6-9249-73797aa814f9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.326013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431ec1b-0464-4aaf-9e73-ce466eddb09d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.326284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431ec1b-0464-4aaf-9e73-ce466eddb09d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.326557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431ec1b-0464-4aaf-9e73-ce466eddb09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.331192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.331867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.332147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.332420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.333046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.335013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.356460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8431ec1b-0464-4aaf-9e73-ce466eddb09d None None] MFA Rules not processed for user `5fae2ad68a2742be8dfe90683de3b9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:17.357915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8431ec1b-0464-4aaf-9e73-ce466eddb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:17.441334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1127/2276] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:17.442201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.442483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.442758 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.474464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:17.474464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:17.491177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1128/2277] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:17.491177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.491177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:17.491567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1150/2278] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:17.492131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.495455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:17.529861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183f601-8864-4b6f-9667-75e377092157 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.535516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78db59f-3b48-4385-b956-327234e41477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.536196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78db59f-3b48-4385-b956-327234e41477 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.536498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78db59f-3b48-4385-b956-327234e41477 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.536807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78db59f-3b48-4385-b956-327234e41477 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.537540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78db59f-3b48-4385-b956-327234e41477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.539451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78db59f-3b48-4385-b956-327234e41477 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.554156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1151/2279] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:17.556109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c148-76c5-4943-b04c-6d54bf4c33bc None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.556732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c148-76c5-4943-b04c-6d54bf4c33bc None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.556893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c148-76c5-4943-b04c-6d54bf4c33bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.570327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e142-fdbe-4e67-b686-0e072ceb0cdc None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.574127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.574741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.575020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.575293 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.577214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:17.577401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-f001c148-76c5-4943-b04c-6d54bf4c33bc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:17.578610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f001c148-76c5-4943-b04c-6d54bf4c33bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:17.586685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1152/2280] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:17.589064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001c148-76c5-4943-b04c-6d54bf4c33bc None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.597920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001c148-76c5-4943-b04c-6d54bf4c33bc None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.602647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.603320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.603735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.604012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.604698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.606337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.620338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1153/2281] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:17.620338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.628642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1eb5-0d58-447a-89bf-d41385d21dbe admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.640066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.640704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.641157 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.641460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.642122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:17.642694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.644332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.645771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.647253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.658668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1154/2282] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:17.659513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.663882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1129/2283] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:17.664777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.670233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817e1ae-c8b6-4e8c-a3ba-8323e82c4192 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.683004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.683736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.683988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.684261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] PATH_INFO: `/v3/projects/5b7ea479bdec447495748d8eb8832e07/users/0132be8aa73945d7864b2893fb7ca7f7/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.698845 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f647554-45c1-47bd-85f0-143dbce768dc service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:17.708361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68087d6-16a3-42b8-a1f6-c067ac2fdbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:17.709141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68087d6-16a3-42b8-a1f6-c067ac2fdbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.709421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68087d6-16a3-42b8-a1f6-c067ac2fdbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.709693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68087d6-16a3-42b8-a1f6-c067ac2fdbf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.710345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68087d6-16a3-42b8-a1f6-c067ac2fdbf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.713492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68087d6-16a3-42b8-a1f6-c067ac2fdbf0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.728987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7ea479bdec447495748d8eb8832e07, user_id=0132be8aa73945d7864b2893fb7ca7f7, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:17.728987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:17.874344 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:17.884056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1155/2284] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:17 2022] PUT /identity/v3/projects/5b7ea479bdec447495748d8eb8832e07/users/0132be8aa73945d7864b2893fb7ca7f7/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:17.884380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1130/2285] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:17.895530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:17.898238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa3eeb-cf69-4aa8-bba7-7f3b9a87197f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:17.898469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa3eeb-cf69-4aa8-bba7-7f3b9a87197f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:17.898748 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa3eeb-cf69-4aa8-bba7-7f3b9a87197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:17.967903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-43fa3eeb-cf69-4aa8-bba7-7f3b9a87197f None None] MFA Rules not processed for user `0132be8aa73945d7864b2893fb7ca7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:17.969129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-43fa3eeb-cf69-4aa8-bba7-7f3b9a87197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:17.994231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786743b-93f7-4b20-a06d-f0b221ebdce4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.035299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1131/2286] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:18.039952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa3eeb-cf69-4aa8-bba7-7f3b9a87197f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.079775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.080434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.080718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.080993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.081622 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.083581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.104763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa3eeb-cf69-4aa8-bba7-7f3b9a87197f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.111731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.112358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.112643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.112918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.113563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.115625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.213775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:18.225397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1156/2287] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:17 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:18.226521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.237306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941afab-f317-4953-8431-880f51c7465d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.243487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.248174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.248174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.248174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.248174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.248174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.258876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1157/2288] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:18.263192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.276375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1132/2289] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:18 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:18.276584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db32acc-fe52-4ab1-a926-8a0d60bf5bc8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.277522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.338990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.339641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.340070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.340358 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.341012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.342681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.355143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8adf6a-e89c-475f-b37d-2c152b27d647 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.357171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1158/2290] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:18.360105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.361421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.362111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.362457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.362798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.363533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.365646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.374210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde7b7d-22df-4357-bf96-b2559d7b3509 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.381908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b2dfc-12bd-45b2-9a03-0589d5417427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.382643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2dfc-12bd-45b2-9a03-0589d5417427 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.382924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2dfc-12bd-45b2-9a03-0589d5417427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.383198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2dfc-12bd-45b2-9a03-0589d5417427 admin admin] PATH_INFO: `/v3/projects/4600f776fb78446ab25a3ee913934fcc/users/cf3712f97958438581b8e153723a1d71/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.399668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b2dfc-12bd-45b2-9a03-0589d5417427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4600f776fb78446ab25a3ee913934fcc, user_id=cf3712f97958438581b8e153723a1d71, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.402614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b2dfc-12bd-45b2-9a03-0589d5417427 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.494022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1133/2291] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:18 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:18.503241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.522174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d1d67-f498-41ba-8ef3-8282654c39bb admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.527180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1159/2292] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:18 2022] PUT /identity/v3/projects/4600f776fb78446ab25a3ee913934fcc/users/cf3712f97958438581b8e153723a1d71/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:18.532463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.533458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.533935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.566137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:18.567445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:18.602180 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.602826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.603111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.603412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.604093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.605979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.619109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1134/2293] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:18.623774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.636947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6391439-9d51-478d-b311-fbabdeb9c20a admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.643420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.644151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.644431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.644853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] PATH_INFO: `/v3/projects/54c3fe46936b490d9f75945a344f8fde/users/3d9344d8cbf44087a77574eae598fc58/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.645287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1160/2294] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:18.662695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.662695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:18.673580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c3fe46936b490d9f75945a344f8fde, user_id=3d9344d8cbf44087a77574eae598fc58, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.676587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.728077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d170e19-b5c6-46d5-8262-d90635a30524 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.731763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.732387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.732687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.732990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.743195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.744631 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.755337 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1161/2295] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:18.796928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1135/2296] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:18 2022] PUT /identity/v3/projects/54c3fe46936b490d9f75945a344f8fde/users/3d9344d8cbf44087a77574eae598fc58/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:18.811999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.817420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e0c1-dac9-402c-b3c1-42a7f4f2a506 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.888833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82d48-feb8-40b3-b0ee-20c4be0e254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.889458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82d48-feb8-40b3-b0ee-20c4be0e254c admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.889745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82d48-feb8-40b3-b0ee-20c4be0e254c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.890019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82d48-feb8-40b3-b0ee-20c4be0e254c admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.890681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82d48-feb8-40b3-b0ee-20c4be0e254c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.893509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82d48-feb8-40b3-b0ee-20c4be0e254c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:18.904922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1162/2297] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:18.909630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:18.921033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed1f7d-bab4-4412-a084-22dd804b483f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:18.926250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:18.927121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:18.927440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:18.927805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] PATH_INFO: `/v3/projects/54c3fe46936b490d9f75945a344f8fde/users/3d9344d8cbf44087a77574eae598fc58/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:18.930595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c3fe46936b490d9f75945a344f8fde, user_id=3d9344d8cbf44087a77574eae598fc58, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:18.934714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:19.003415 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf96c-8364-4eca-9b8e-85189851fa92 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:19.004479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf96c-8364-4eca-9b8e-85189851fa92 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:19.004479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf96c-8364-4eca-9b8e-85189851fa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:19.006729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1136/2298] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:18 2022] PUT /identity/v3/projects/54c3fe46936b490d9f75945a344f8fde/users/3d9344d8cbf44087a77574eae598fc58/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:19.049261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:19.049261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-765bf96c-8364-4eca-9b8e-85189851fa92 None None] MFA Rules not processed for user `3d9344d8cbf44087a77574eae598fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:19.068212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-765bf96c-8364-4eca-9b8e-85189851fa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:19.193962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1163/2299] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:19.206373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:19.281415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4564e2-2a2f-4149-a7ad-7478a128dfee admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:19.287630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f2eb0-040a-4833-927c-db396dc242d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:19.288281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2eb0-040a-4833-927c-db396dc242d1 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:19.296735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2eb0-040a-4833-927c-db396dc242d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:19.296735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2eb0-040a-4833-927c-db396dc242d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:19.298722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2eb0-040a-4833-927c-db396dc242d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:19.300236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2eb0-040a-4833-927c-db396dc242d1 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:19.310346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1137/2300] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:19.418997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf96c-8364-4eca-9b8e-85189851fa92 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:19.428853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf96c-8364-4eca-9b8e-85189851fa92 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:19.432578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:19.433204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:19.433488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:19.433776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:19.504715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:19.506410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:19.522170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1164/2301] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:20.019589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:20.227034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:21.374257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:21.773271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:22.388952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:22.602295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:23.060288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:23.677135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:23.835549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:24.562412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:25.555302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:25.555957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:25.555957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:25.595949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] MFA Rules not processed for user `cf3712f97958438581b8e153723a1d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:25.598699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:25.701714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1138/2302] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:25.716608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:25.718705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:25.837823 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9617-f2e9-4764-9f27-7a3c4920f8b3 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:25.845080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:25.845690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:25.845999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:25.846542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:25.857068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:25.858840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:25.869380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1165/2303] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:26.072861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:26.074793 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:26.134827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:26.175004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cc86-1631-4036-9e39-ce4b75acbaf4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:26.179892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:26.180545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:26.180824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:26.181101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] PATH_INFO: `/v3/users/fbfb82ddf22c4ff6a6b6d4f27588a16b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:26.182318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbfb82ddf22c4ff6a6b6d4f27588a16b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:26.184547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:26.306305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:26.320120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd457a-387b-4720-94a7-6cd0cf08fb8a service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:26.327822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:26.328733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:26.329349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:26.329747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] PATH_INFO: `/v3/users/0132be8aa73945d7864b2893fb7ca7f7` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:26.331425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0132be8aa73945d7864b2893fb7ca7f7)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:26.334329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:26.534984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:26.551670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbfb82ddf22c4ff6a6b6d4f27588a16b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.552524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbfb82ddf22c4ff6a6b6d4f27588a16b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.560254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbfb82ddf22c4ff6a6b6d4f27588a16b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.561146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbfb82ddf22c4ff6a6b6d4f27588a16b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.579695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-42204345-eb70-4778-a684-958aec1181f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbfb82ddf22c4ff6a6b6d4f27588a16b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.728712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1139/2304] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:26 2022] DELETE /identity/v3/users/fbfb82ddf22c4ff6a6b6d4f27588a16b => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:26.734730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:26.735060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:26.735321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:26.757153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0132be8aa73945d7864b2893fb7ca7f7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.769290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0132be8aa73945d7864b2893fb7ca7f7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.770139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0132be8aa73945d7864b2893fb7ca7f7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.779491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:26.781987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:26.798419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0132be8aa73945d7864b2893fb7ca7f7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.904826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1140/2305] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:26.916650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:26.917031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-28621a39-f2bb-4d2d-891a-48060b36030a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0132be8aa73945d7864b2893fb7ca7f7'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:26.920804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:26.928002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1166/2306] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:26 2022] DELETE /identity/v3/users/0132be8aa73945d7864b2893fb7ca7f7 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:26.932376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:26.932679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:26.932948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:26.987741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:26.992234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:27.064080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a425488-274c-4c49-8c36-f786724054f2 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:27.142678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:27.142678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:27.142678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:27.143603 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:27.149000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:27.200741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1167/2307] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:27.259827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:27.261740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:27.289113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043c23-f596-49c4-8041-3fc587b81a8c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:27.294072 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:27.303119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:27.303725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:27.304009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:27.304284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:27.337893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:27.343256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:27.348055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:27.351825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:27.371456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1141/2308] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:27.379659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1168/2309] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:28.243854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:28.243854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:28.250277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634da8d3-120e-4cfe-a91d-52993d56360a service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:28.265287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:28.266142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:28.268722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:28.268878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] PATH_INFO: `/v3/projects/0f90cfe27c5846ca9af5407f2f93584e` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:28.271048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f90cfe27c5846ca9af5407f2f93584e)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:28.273807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:28.289894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:28.292680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:28.332581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433977e-9dcf-4dce-8a52-298ab98c0188 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:28.338330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:28.339242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:28.340016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:28.343101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] PATH_INFO: `/v3/projects/5b7ea479bdec447495748d8eb8832e07` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:28.343101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7ea479bdec447495748d8eb8832e07)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:28.344118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:28.475148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f90cfe27c5846ca9af5407f2f93584e', 'request_id': 'req-754b176d-12ce-4d67-b9cb-7731218b6ed5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.487101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f90cfe27c5846ca9af5407f2f93584e', 'request_id': 'req-754b176d-12ce-4d67-b9cb-7731218b6ed5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.520262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7ea479bdec447495748d8eb8832e07', 'request_id': 'req-4732e748-7cad-4008-8c6b-e4964d1488de'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.534074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7ea479bdec447495748d8eb8832e07', 'request_id': 'req-4732e748-7cad-4008-8c6b-e4964d1488de'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.648677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f90cfe27c5846ca9af5407f2f93584e', 'request_id': 'req-754b176d-12ce-4d67-b9cb-7731218b6ed5'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.671031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] The token cache is being invalidate because project 0f90cfe27c5846ca9af5407f2f93584e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:28.671683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.673510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-754b176d-12ce-4d67-b9cb-7731218b6ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.691132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1142/2310] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:28 2022] DELETE /identity/v3/projects/0f90cfe27c5846ca9af5407f2f93584e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:28.695492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc643c-7615-49c0-9941-934a56e3a8b8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:28.695895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc643c-7615-49c0-9941-934a56e3a8b8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:28.696303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc643c-7615-49c0-9941-934a56e3a8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:28.724448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-21fc643c-7615-49c0-9941-934a56e3a8b8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:28.726671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-21fc643c-7615-49c0-9941-934a56e3a8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:28.733805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7ea479bdec447495748d8eb8832e07', 'request_id': 'req-4732e748-7cad-4008-8c6b-e4964d1488de'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.753900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] The token cache is being invalidate because project 5b7ea479bdec447495748d8eb8832e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:28.754903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.757036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:28.759220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1169/2311] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:28 2022] DELETE /identity/v3/projects/5b7ea479bdec447495748d8eb8832e07 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:28.769117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:28.773254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:28.797194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:28.896298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732e748-7cad-4008-8c6b-e4964d1488de admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:28.909901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:28.910770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:28.911065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:28.911345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] PATH_INFO: `/v3/users/3d9344d8cbf44087a77574eae598fc58` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:28.913791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9344d8cbf44087a77574eae598fc58)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:28.915938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:28.939832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1143/2312] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:28.946691 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18e411-f28c-471c-8c7d-d52779e4d7fc None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:28.947231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18e411-f28c-471c-8c7d-d52779e4d7fc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:28.947693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18e411-f28c-471c-8c7d-d52779e4d7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:28.976683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-cb18e411-f28c-471c-8c7d-d52779e4d7fc None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:28.979440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cb18e411-f28c-471c-8c7d-d52779e4d7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:28.989551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1144/2313] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:28.997134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18e411-f28c-471c-8c7d-d52779e4d7fc None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:29.031630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18e411-f28c-471c-8c7d-d52779e4d7fc None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:29.036562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:29.037190 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.037468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.037892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:29.038892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:29.039207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:29.040882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:29.058538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1145/2314] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:29.060150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:29.072732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc017-99be-4216-90e9-d7544e91f2c3 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:29.082924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:29.083763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.084112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.084470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:29.085462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:29.087952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:29.199602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1146/2315] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:29 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:29.203523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:29.279992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9344d8cbf44087a77574eae598fc58'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:29.301121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9344d8cbf44087a77574eae598fc58'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:29.303005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9344d8cbf44087a77574eae598fc58'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:29.323430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8017-af65-4c2f-9d69-d428b0b08e6f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:29.326232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9344d8cbf44087a77574eae598fc58'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:29.338470 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:29.339115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.340820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.341103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:29.346234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:29.346804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:29.443757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9344d8cbf44087a77574eae598fc58'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:29.468192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1170/2316] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:28 2022] DELETE /identity/v3/users/3d9344d8cbf44087a77574eae598fc58 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:29.541185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1147/2317] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:29 2022] POST /identity/v3/users => generated 283 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:29.545252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:29.546838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:29.619806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:29.621849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:29.647706 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f13e-dc73-4b44-8618-602d7cc862fc admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:29.653484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:29.654119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.654404 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.654681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:29.655342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:29.657075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:29.695718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1171/2318] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:29.697293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:29.718278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742fd7f-bea5-4fe5-a334-0e19ac41a923 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:29.722685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fccbac-309d-4610-a878-73faff029023 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:29.738422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:29.739064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.739351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.739708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:29.740375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:29.750241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:29.771391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1172/2319] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:29.771391 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:29.790572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7028d-f319-4b05-87a9-faeabea9ec74 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:29.798992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c9a7f-6000-41c3-84f5-61b9c527becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:29.799749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9a7f-6000-41c3-84f5-61b9c527becb admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.800054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9a7f-6000-41c3-84f5-61b9c527becb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.800298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9a7f-6000-41c3-84f5-61b9c527becb admin admin] PATH_INFO: `/v3/projects/bb2bee8abaaf45bd8f0dd6361cbf589c/users/e04ed5fe1db543438c3a9aac33d00b3a/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:29.841875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c9a7f-6000-41c3-84f5-61b9c527becb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2bee8abaaf45bd8f0dd6361cbf589c, user_id=e04ed5fe1db543438c3a9aac33d00b3a, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:29.848809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c9a7f-6000-41c3-84f5-61b9c527becb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:29.907514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:29.908194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.909409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.909762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:29.916055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:29.940843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1173/2320] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:29 2022] PUT /identity/v3/projects/bb2bee8abaaf45bd8f0dd6361cbf589c/users/e04ed5fe1db543438c3a9aac33d00b3a/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:29.956640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:29.956989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:29.957215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.017284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] MFA Rules not processed for user `e04ed5fe1db543438c3a9aac33d00b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:30.018966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:30.080491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:30.087908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:30.115586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1148/2321] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:30.141179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1174/2322] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:30.148882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:30.151527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:30.168058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703432f-d705-4fda-ab9e-c8db4434fb04 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:30.257788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:30.264744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29021b3f-8b7c-43cd-8061-7706e5893c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:30.265484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021b3f-8b7c-43cd-8061-7706e5893c37 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:30.265820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021b3f-8b7c-43cd-8061-7706e5893c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:30.266103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021b3f-8b7c-43cd-8061-7706e5893c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.267000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:30.277404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29021b3f-8b7c-43cd-8061-7706e5893c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:30.279049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29021b3f-8b7c-43cd-8061-7706e5893c37 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:30.290637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1149/2323] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:30.434923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944a97-506c-4dfd-bc2e-b425bb02b178 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:30.441765 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:30.443032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:30.443542 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:30.444005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] PATH_INFO: `/v3/projects/54c3fe46936b490d9f75945a344f8fde` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.445810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c3fe46936b490d9f75945a344f8fde)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:30.447964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:30.588448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c3fe46936b490d9f75945a344f8fde', 'request_id': 'req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:30.594225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c3fe46936b490d9f75945a344f8fde', 'request_id': 'req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:30.705890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c3fe46936b490d9f75945a344f8fde', 'request_id': 'req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:30.727986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] The token cache is being invalidate because project 54c3fe46936b490d9f75945a344f8fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:30.728610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:30.729419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c4dafe19-a27b-44c1-8ed6-6598ee48d05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:30.731924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1175/2324] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:30 2022] DELETE /identity/v3/projects/54c3fe46936b490d9f75945a344f8fde => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:30.737337 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd617c6-8bf3-4aa3-8f9f-702564cde79c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:30.737847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd617c6-8bf3-4aa3-8f9f-702564cde79c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:30.737958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd617c6-8bf3-4aa3-8f9f-702564cde79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.760009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6dd617c6-8bf3-4aa3-8f9f-702564cde79c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:30.761786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6dd617c6-8bf3-4aa3-8f9f-702564cde79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:30.844786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1150/2325] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:30.852788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e2c0-814d-4fef-abfb-8e9a3f79c17d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:30.853978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e2c0-814d-4fef-abfb-8e9a3f79c17d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:30.853978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e2c0-814d-4fef-abfb-8e9a3f79c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.868647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7988-633f-4415-8140-369da947356a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:30.868894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7988-633f-4415-8140-369da947356a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:30.869121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7988-633f-4415-8140-369da947356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.884964 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8685e2c0-814d-4fef-abfb-8e9a3f79c17d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:30.886284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8685e2c0-814d-4fef-abfb-8e9a3f79c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:30.892147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-260d7988-633f-4415-8140-369da947356a None None] MFA Rules not processed for user `cf3712f97958438581b8e153723a1d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:30.893679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-260d7988-633f-4415-8140-369da947356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:30.896798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1176/2326] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:30.901146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e2c0-814d-4fef-abfb-8e9a3f79c17d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:30.913579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e2c0-814d-4fef-abfb-8e9a3f79c17d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:30.917705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:30.925270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:30.925270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:30.925270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:30.925270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.925556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:30.925556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:30.926322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:30.956078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1177/2327] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:55:30.959846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:30.977500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e035a-d9e3-42cc-b267-e5f6a5452b73 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:30.990675 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:30.991447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:30.991746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:30.992023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:30.993372 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:30.996546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:31.011317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1151/2328] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:55:31.178619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7988-633f-4415-8140-369da947356a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:31.180876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-260d7988-633f-4415-8140-369da947356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:31.199268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7988-633f-4415-8140-369da947356a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:31.206114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:31.207726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:31.208120 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:31.208503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] PATH_INFO: `/v3/users/258f2a68807b4b9da1d538c918eab720` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:31.209967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=258f2a68807b4b9da1d538c918eab720)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:31.212303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:31.252239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1178/2329] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:30 2022] POST /identity/v3/projects => generated 377 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:31.255403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:31.381609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a895a-e79e-4d70-97ea-0851f800dfae admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:31.388603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:31.389779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:31.390449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:31.390882 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:31.391760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:31.394136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:31.498028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1179/2330] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:31 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:31.501754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:31.512922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3064f7-1b19-4519-b937-0323b3216550 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:31.522386 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:31.523002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:31.523283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:31.523600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:31.524417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:31.528144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:31.537012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258f2a68807b4b9da1d538c918eab720'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:31.539163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258f2a68807b4b9da1d538c918eab720'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:31.546392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1180/2331] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:31.548545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:31.550939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:31.552407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258f2a68807b4b9da1d538c918eab720'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:31.553372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258f2a68807b4b9da1d538c918eab720'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:31.566935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001ffd-c46d-4d51-94db-fd7bfe6320bd admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:31.567563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-637f5740-5868-4b17-ab0a-2b3e62267c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258f2a68807b4b9da1d538c918eab720'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:31.573376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:31.573995 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:31.574374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:31.574702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:31.575431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:31.577265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:31.588043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1181/2332] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:55:31.593967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:31.602131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45496fa8-5497-4c13-83e5-a841a215bf45 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:31.606989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf06b7-4f50-4bb6-ba8a-4782639b91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:31.607692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf06b7-4f50-4bb6-ba8a-4782639b91ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:31.607980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf06b7-4f50-4bb6-ba8a-4782639b91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:31.608286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf06b7-4f50-4bb6-ba8a-4782639b91ff admin admin] PATH_INFO: `/v3/projects/7cbdb5a86a494a4dabc31b843f8fdc19/users/33ae9e9bad2f450a8c85c6320965b032/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:31.624390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf06b7-4f50-4bb6-ba8a-4782639b91ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbdb5a86a494a4dabc31b843f8fdc19, user_id=33ae9e9bad2f450a8c85c6320965b032, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:31.627663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf06b7-4f50-4bb6-ba8a-4782639b91ff admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:31.676982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1152/2333] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:31 2022] DELETE /identity/v3/users/258f2a68807b4b9da1d538c918eab720 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:31.684955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:31.685248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:31.685523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:31.708231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:31.708507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:31.840374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1182/2334] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:31 2022] PUT /identity/v3/projects/7cbdb5a86a494a4dabc31b843f8fdc19/users/33ae9e9bad2f450a8c85c6320965b032/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:31.840707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1153/2335] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:31.852241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:31.853126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:31.853592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:31.853722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:31.854162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:31.888378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] MFA Rules not processed for user `33ae9e9bad2f450a8c85c6320965b032`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:32.076139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:32.076363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b279a3-a84d-4324-a697-1886630a2498 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:32.076560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1183/2336] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:32.076653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:32.076653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:32.076653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:32.076653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:32.076991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:32.076991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:32.076991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1154/2337] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:55:32.077232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:32.077232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:32.128578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a03649-e842-4376-80eb-21a92e771f8a None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:32.132769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba50941-cdd1-44de-a239-973d27dec326 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:32.133395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba50941-cdd1-44de-a239-973d27dec326 service glance] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:32.133672 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba50941-cdd1-44de-a239-973d27dec326 service glance] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:32.133944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba50941-cdd1-44de-a239-973d27dec326 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:32.143858 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba50941-cdd1-44de-a239-973d27dec326 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:32.145313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba50941-cdd1-44de-a239-973d27dec326 service glance] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:32.154657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1184/2338] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:32.616828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:32.618445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:32.633358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53ff40-21e3-4e3e-bcce-65fd40d70269 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:32.639804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:32.640613 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:32.643453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:32.643453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] PATH_INFO: `/v3/projects/fd5dbc5f0e6942c6bc6a0b6f1ff59644` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:32.643738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5dbc5f0e6942c6bc6a0b6f1ff59644)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:32.645654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:32.845294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5dbc5f0e6942c6bc6a0b6f1ff59644', 'request_id': 'req-107fd371-5668-44d7-a844-360cdcf81e16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:32.851763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5dbc5f0e6942c6bc6a0b6f1ff59644', 'request_id': 'req-107fd371-5668-44d7-a844-360cdcf81e16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:32.962416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5dbc5f0e6942c6bc6a0b6f1ff59644', 'request_id': 'req-107fd371-5668-44d7-a844-360cdcf81e16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:32.978335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] The token cache is being invalidate because project fd5dbc5f0e6942c6bc6a0b6f1ff59644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:32.978639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:32.979342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-107fd371-5668-44d7-a844-360cdcf81e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:32.980952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1155/2339] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:32 2022] DELETE /identity/v3/projects/fd5dbc5f0e6942c6bc6a0b6f1ff59644 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:32.985945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8656b-3f33-4266-a5f7-432325d3918d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:32.986438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8656b-3f33-4266-a5f7-432325d3918d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:32.986561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8656b-3f33-4266-a5f7-432325d3918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.013167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b4a8656b-3f33-4266-a5f7-432325d3918d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:33.013167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b4a8656b-3f33-4266-a5f7-432325d3918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:33.068429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1185/2340] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:33.078005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa4ef-7042-4cc4-97b3-5218f713155d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.078287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa4ef-7042-4cc4-97b3-5218f713155d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.078552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa4ef-7042-4cc4-97b3-5218f713155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.100706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-099aa4ef-7042-4cc4-97b3-5218f713155d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:33.102068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-099aa4ef-7042-4cc4-97b3-5218f713155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:33.113360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1156/2341] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:33.117907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8656b-3f33-4266-a5f7-432325d3918d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:33.130241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8656b-3f33-4266-a5f7-432325d3918d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:33.135609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:33.136314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.136878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.137009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.138226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:33.138554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:33.140681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:33.163822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1186/2342] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:33.172217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa4ef-7042-4cc4-97b3-5218f713155d None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:33.181922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa4ef-7042-4cc4-97b3-5218f713155d None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:33.186714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:33.187340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.187655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.187928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.189295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:33.191256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:33.341585 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1157/2343] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:33 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:33.342736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:33.359426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2fd7-1fc1-4357-9929-ad16ead47acd admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:33.489053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:33.489971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.490413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.490772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.491518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:33.495045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:33.647209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1187/2344] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:33 2022] POST /identity/v3/users => generated 287 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:33.651889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:33.669340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8eb82-d478-494f-92e5-7b76bf81cbe4 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:33.675621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:33.676464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.676634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.677262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.678757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:33.681362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:33.698605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1158/2345] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:33.702922 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:33.715983 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6120c-21f1-4ca6-81c2-06aeef0c07e2 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:33.721220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922ab9-dd98-4184-8fc0-34dccb959a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:33.721950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ab9-dd98-4184-8fc0-34dccb959a85 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.722298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ab9-dd98-4184-8fc0-34dccb959a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.722679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ab9-dd98-4184-8fc0-34dccb959a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.723349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922ab9-dd98-4184-8fc0-34dccb959a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:33.725015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922ab9-dd98-4184-8fc0-34dccb959a85 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:33.747794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1188/2346] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:33.747884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:33.753523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b685e9-9409-4da0-abbe-b3fc55f327e2 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:33.758723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:33.759403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.760011 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.760471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] PATH_INFO: `/v3/projects/5fa2513bf86b4944b39fac11cae5a2ed/users/ee788b45fcf6453b9747506b1a04fdda/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.777313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa2513bf86b4944b39fac11cae5a2ed, user_id=ee788b45fcf6453b9747506b1a04fdda, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:33.780077 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:33.904961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1159/2347] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:33 2022] PUT /identity/v3/projects/5fa2513bf86b4944b39fac11cae5a2ed/users/ee788b45fcf6453b9747506b1a04fdda/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:33.915905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:33.916287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:33.916590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:33.941990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:33.957173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] MFA Rules not processed for user `ee788b45fcf6453b9747506b1a04fdda`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:33.958609 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:34.090381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1189/2348] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:34.128463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:34.134994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:34.200056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446731-0365-40c9-9d78-0750fccbb29f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:34.204117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27820c0-01f2-4f13-9c43-8a6cfbefee5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:34.204742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27820c0-01f2-4f13-9c43-8a6cfbefee5e service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:34.205024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27820c0-01f2-4f13-9c43-8a6cfbefee5e service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:34.205336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27820c0-01f2-4f13-9c43-8a6cfbefee5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:34.215995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27820c0-01f2-4f13-9c43-8a6cfbefee5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:34.217510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27820c0-01f2-4f13-9c43-8a6cfbefee5e service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:34.231630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1160/2349] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:35.511493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:37.404232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:37.517328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:38.551239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:39.157306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:39.158988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:39.231703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a060f9-2113-4572-ad47-7565cc02707d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:39.236864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:39.237539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:39.241277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:39.241277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] PATH_INFO: `/v3/users/ecd13529f31f415f8ac6f08592e8dd3d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:39.241277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd13529f31f415f8ac6f08592e8dd3d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:39.241547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:39.500083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd13529f31f415f8ac6f08592e8dd3d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:39.511519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd13529f31f415f8ac6f08592e8dd3d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:39.512388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd13529f31f415f8ac6f08592e8dd3d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:39.541375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd13529f31f415f8ac6f08592e8dd3d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:39.613746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd13529f31f415f8ac6f08592e8dd3d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:39.620340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1190/2350] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:39 2022] DELETE /identity/v3/users/ecd13529f31f415f8ac6f08592e8dd3d => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:39.624938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:39.625485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:39.625485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:39.631500 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:39.645253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:39.646478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:39.717182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1161/2351] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:39.729663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:39.731087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:39.799762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6dc4b-d379-4da3-80f4-9e322d11a347 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:39.803739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:39.807782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:39.808086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:39.808370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:39.819203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:39.823328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:39.833545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1191/2352] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:40.438426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:40.440972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:40.456310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f1970-14c9-4e17-818c-0a98e3f6b9f5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:40.462523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:40.463270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:40.463674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:40.464145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] PATH_INFO: `/v3/projects/6adb68ea65dd4a76bd23ec5de57ae006` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:40.469562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adb68ea65dd4a76bd23ec5de57ae006)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:40.469562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:40.698504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adb68ea65dd4a76bd23ec5de57ae006', 'request_id': 'req-6910465c-782d-4912-ab74-be3cfc09c561'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:40.711657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adb68ea65dd4a76bd23ec5de57ae006', 'request_id': 'req-6910465c-782d-4912-ab74-be3cfc09c561'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:40.854800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adb68ea65dd4a76bd23ec5de57ae006', 'request_id': 'req-6910465c-782d-4912-ab74-be3cfc09c561'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:40.872602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] The token cache is being invalidate because project 6adb68ea65dd4a76bd23ec5de57ae006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:40.874166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:40.874166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:40.875340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1162/2353] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:40 2022] DELETE /identity/v3/projects/6adb68ea65dd4a76bd23ec5de57ae006 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:40.879474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:40.889931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb982a-f242-4bbe-9b41-bb67f237ce67 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:40.893806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:40.947007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:40.947673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:40.947954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:40.948230 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] PATH_INFO: `/v3/users/5fae2ad68a2742be8dfe90683de3b9dc` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:40.949379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fae2ad68a2742be8dfe90683de3b9dc)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:40.951295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:41.173084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fae2ad68a2742be8dfe90683de3b9dc'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:41.180566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fae2ad68a2742be8dfe90683de3b9dc'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:41.181261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fae2ad68a2742be8dfe90683de3b9dc'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:41.196688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fae2ad68a2742be8dfe90683de3b9dc'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:41.311065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-510ccc04-a355-44f4-b173-d7bd043b3911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fae2ad68a2742be8dfe90683de3b9dc'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:41.311065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1192/2354] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:55:40 2022] DELETE /identity/v3/users/5fae2ad68a2742be8dfe90683de3b9dc => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:55:41.708357 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:41.848676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:41.850772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:41.865382 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910465c-782d-4912-ab74-be3cfc09c561 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:41.953963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:41.954774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:41.955058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:41.955347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] PATH_INFO: `/v3/projects/d719ad54990c47b7acd0182d4b845b7d` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:41.956663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d719ad54990c47b7acd0182d4b845b7d)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:41.958643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:42.083914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd719ad54990c47b7acd0182d4b845b7d', 'request_id': 'req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:42.089716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd719ad54990c47b7acd0182d4b845b7d', 'request_id': 'req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:42.237881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd719ad54990c47b7acd0182d4b845b7d', 'request_id': 'req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:42.252737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] The token cache is being invalidate because project d719ad54990c47b7acd0182d4b845b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:55:42.253062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:42.253692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bb0d8177-24b8-4283-9eb5-acfaa2fd2e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:55:42.255208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1163/2355] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:55:41 2022] DELETE /identity/v3/projects/d719ad54990c47b7acd0182d4b845b7d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:42.264193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00da0d-58a6-48b9-8426-0a06c5543c54 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.264981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00da0d-58a6-48b9-8426-0a06c5543c54 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.264981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00da0d-58a6-48b9-8426-0a06c5543c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.285422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5c00da0d-58a6-48b9-8426-0a06c5543c54 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:42.286705 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5c00da0d-58a6-48b9-8426-0a06c5543c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:42.347857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1193/2356] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:42.357904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7acfa3-4861-4a4d-bf98-ec0d3b2b4778 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.358192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7acfa3-4861-4a4d-bf98-ec0d3b2b4778 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.358471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7acfa3-4861-4a4d-bf98-ec0d3b2b4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.379215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1d7acfa3-4861-4a4d-bf98-ec0d3b2b4778 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:42.380478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1d7acfa3-4861-4a4d-bf98-ec0d3b2b4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:42.388948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1164/2357] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:42.393330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00da0d-58a6-48b9-8426-0a06c5543c54 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:42.403409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00da0d-58a6-48b9-8426-0a06c5543c54 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:42.413263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:42.413263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.413263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.413263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.413849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:42.413849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:42.413849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:42.427229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1194/2358] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:42.431813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7acfa3-4861-4a4d-bf98-ec0d3b2b4778 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:42.442776 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7acfa3-4861-4a4d-bf98-ec0d3b2b4778 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:42.453418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:42.454118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.455021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.457637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.457637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:42.458278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:42.623979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1165/2359] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:55:42 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:42.627422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:42.637741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6cea9-20df-433a-9fbe-9a88943ab9a6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:42.708443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:42.708443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.708443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.709102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.709562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:42.711728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:42.822335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1195/2360] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:55:42 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:42.823532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:42.844450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacfdef-4ece-4550-9c5b-ceefd85d4ca5 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:42.857681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:42.858514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.858887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.859310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.860141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:42.862494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:42.873964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1166/2361] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:42.878573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:42.894863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a014-1079-4c24-816b-5ae6e0a5fbc3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:42.900095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebddba-a3c5-4017-82e7-2d53ff51574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:42.900868 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebddba-a3c5-4017-82e7-2d53ff51574b admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.901255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebddba-a3c5-4017-82e7-2d53ff51574b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.901656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebddba-a3c5-4017-82e7-2d53ff51574b admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.902428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebddba-a3c5-4017-82e7-2d53ff51574b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:42.904328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebddba-a3c5-4017-82e7-2d53ff51574b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:42.918301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1196/2362] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:55:42.923531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:42.936169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f6a5a-e7b5-462b-b7e7-5f856b7657f1 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:42.952316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:42.953045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:42.954413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:42.954712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] PATH_INFO: `/v3/projects/ed7dcde84c3c45858149437467b4d929/users/6649e1e4f7454bcea2a6697b4ece3a43/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:42.973768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7dcde84c3c45858149437467b4d929, user_id=6649e1e4f7454bcea2a6697b4ece3a43, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:42.976545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:43.075349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1167/2363] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:55:42 2022] PUT /identity/v3/projects/ed7dcde84c3c45858149437467b4d929/users/6649e1e4f7454bcea2a6697b4ece3a43/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:55:43.089396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:43.089763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:43.090052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:43.119797 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:43.159934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] MFA Rules not processed for user `6649e1e4f7454bcea2a6697b4ece3a43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:43.161673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:43.286476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1197/2364] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:55:43.289830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:43.354714 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:43.357138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:43.429977 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776ad46-c958-473d-aea1-6639b03ea57d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:43.435485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc786418-f90e-41bb-8893-ae69ef16ee54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:43.435485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc786418-f90e-41bb-8893-ae69ef16ee54 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:43.435485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc786418-f90e-41bb-8893-ae69ef16ee54 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:43.435485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc786418-f90e-41bb-8893-ae69ef16ee54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:43.445068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc786418-f90e-41bb-8893-ae69ef16ee54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:43.446650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc786418-f90e-41bb-8893-ae69ef16ee54 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:43.456284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1168/2365] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:55:45.847158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:45.961192 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:56.813981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:56.863445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=8 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:01.327112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:01.328697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:01.401987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abf12-568e-4097-8019-a20bf8ffb1b0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:01.410131 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:01.411955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.412366 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.421970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] PATH_INFO: `/v3/users/ee788b45fcf6453b9747506b1a04fdda` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.421970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee788b45fcf6453b9747506b1a04fdda)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:01.421970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:01.652177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee788b45fcf6453b9747506b1a04fdda'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:01.659399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee788b45fcf6453b9747506b1a04fdda'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:01.660192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee788b45fcf6453b9747506b1a04fdda'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:01.673583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee788b45fcf6453b9747506b1a04fdda'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:01.761435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee788b45fcf6453b9747506b1a04fdda'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:01.769456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1198/2366] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:56:01 2022] DELETE /identity/v3/users/ee788b45fcf6453b9747506b1a04fdda => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:01.775058 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.780116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.780116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.795526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:01.796755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:01.862450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1169/2367] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:56:01.872872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:01.874360 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:01.933938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bab2a-02d3-4134-b922-fa239a9620aa admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:01.937575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daaef3-9c3a-4ffa-b4ef-59f4880358f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:01.938187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daaef3-9c3a-4ffa-b4ef-59f4880358f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.938470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daaef3-9c3a-4ffa-b4ef-59f4880358f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.938744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daaef3-9c3a-4ffa-b4ef-59f4880358f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.947634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daaef3-9c3a-4ffa-b4ef-59f4880358f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:01.949014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daaef3-9c3a-4ffa-b4ef-59f4880358f7 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:01.958332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1199/2368] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:56:02.478031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:02.479486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:02.493801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0409a-2302-4b0d-a980-c2bd1775a1b3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:02.499795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:02.500523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:02.500884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:02.501236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] PATH_INFO: `/v3/projects/5fa2513bf86b4944b39fac11cae5a2ed` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:02.502467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa2513bf86b4944b39fac11cae5a2ed)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:02.509671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:02.612580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa2513bf86b4944b39fac11cae5a2ed', 'request_id': 'req-67df7716-7c11-4bf6-b583-a6f5eccc9b87'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:02.620847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa2513bf86b4944b39fac11cae5a2ed', 'request_id': 'req-67df7716-7c11-4bf6-b583-a6f5eccc9b87'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:02.700123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa2513bf86b4944b39fac11cae5a2ed', 'request_id': 'req-67df7716-7c11-4bf6-b583-a6f5eccc9b87'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:02.712847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] The token cache is being invalidate because project 5fa2513bf86b4944b39fac11cae5a2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:56:02.713140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:02.713783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:02.715342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1170/2369] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:56:02 2022] DELETE /identity/v3/projects/5fa2513bf86b4944b39fac11cae5a2ed => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:11.183199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198db31-9974-469a-9dac-9fecd6dd0ff6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:11.184174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198db31-9974-469a-9dac-9fecd6dd0ff6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:11.184174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198db31-9974-469a-9dac-9fecd6dd0ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.204239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8198db31-9974-469a-9dac-9fecd6dd0ff6 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:11.205538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8198db31-9974-469a-9dac-9fecd6dd0ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:11.224808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:11.263437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1200/2370] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:11.308597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:11.310161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:11.386413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df7716-7c11-4bf6-b583-a6f5eccc9b87 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:11.392737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:11.393841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:11.394429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:11.395586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.407879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:11.416920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:11.418631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1171/2371] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:56:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:56:12.407330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448c27-3da1-4f80-b56a-deeb9c6548f1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:12.407837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448c27-3da1-4f80-b56a-deeb9c6548f1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:12.414582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448c27-3da1-4f80-b56a-deeb9c6548f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:12.427887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ce448c27-3da1-4f80-b56a-deeb9c6548f1 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:12.429697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ce448c27-3da1-4f80-b56a-deeb9c6548f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:12.437074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1201/2372] 10.222.0.62 () {58 vars in 967 bytes} [Thu Aug 18 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:12.449984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:12.460966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c35199-6313-4dfd-9555-9cb987fd9c78 service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:12.466219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:12.466851 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:12.467127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:12.467422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:12.476869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:12.478444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:12.483741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:12.487591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1172/2373] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:56:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 20:56:13.321575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba512dc-1f9d-4ea2-9f42-081ae9839efb None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:13.321870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba512dc-1f9d-4ea2-9f42-081ae9839efb None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:13.322146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba512dc-1f9d-4ea2-9f42-081ae9839efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:13.341551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-eba512dc-1f9d-4ea2-9f42-081ae9839efb None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:13.342772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-eba512dc-1f9d-4ea2-9f42-081ae9839efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:13.351137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1202/2374] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:13.362800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:13.373371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbdfc6-c1eb-43a4-828f-daa5c8bf0c94 service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:13.378370 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:13.378990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:13.379266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:13.379564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:13.388279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:13.389859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:13.398872 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1173/2375] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:56:14.107075 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:14.107794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:14.107794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:14.127202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:14.128590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:14.136387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1203/2376] 10.222.0.62 () {58 vars in 967 bytes} [Thu Aug 18 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:14.149996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:14.160726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c660e-0fc7-4223-9e0a-254588f4ad99 service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:14.165955 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d1c05-588e-4e89-b0e8-53969f7b1e46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:14.166506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1c05-588e-4e89-b0e8-53969f7b1e46 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:14.166783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1c05-588e-4e89-b0e8-53969f7b1e46 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:14.167059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1c05-588e-4e89-b0e8-53969f7b1e46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:14.175031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d1c05-588e-4e89-b0e8-53969f7b1e46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:14.176665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d1c05-588e-4e89-b0e8-53969f7b1e46 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:14.185549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1174/2377] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:56:18.190945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:18.192461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:18.276000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6c9de-c952-4bc3-b3cb-170cb2e6a2e3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:18.285288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:18.285288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:18.285288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:18.285288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] PATH_INFO: `/v3/users/24bcdddbaba14098b3c12bbc679f988d` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:18.285674 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bcdddbaba14098b3c12bbc679f988d)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:18.287296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:18.574447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bcdddbaba14098b3c12bbc679f988d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:18.582294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bcdddbaba14098b3c12bbc679f988d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:18.583055 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bcdddbaba14098b3c12bbc679f988d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:18.597410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bcdddbaba14098b3c12bbc679f988d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:18.733296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bcdddbaba14098b3c12bbc679f988d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:18.740516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1204/2378] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:56:18 2022] DELETE /identity/v3/users/24bcdddbaba14098b3c12bbc679f988d => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:18.745039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:18.745895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:18.746173 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:18.768578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:18.769834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:18.843883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1175/2379] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:18.857030 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:18.859645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:18.899041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:18.933081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6956c3-63b9-40a1-8df3-48dc42dca998 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:18.936834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:18.937475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:18.937762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:18.938042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:18.948573 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:18.950036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:18.961124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1205/2380] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:19.280619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:19.282290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:19.297535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1ed92-fdd8-4c11-b57f-2be2b65e3448 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:19.303592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:19.306537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:19.306537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:19.306537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] PATH_INFO: `/v3/projects/a616fee258c14f1289fb10ecc7354067` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:19.307481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a616fee258c14f1289fb10ecc7354067)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:19.309655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:19.500775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a616fee258c14f1289fb10ecc7354067', 'request_id': 'req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:19.514237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a616fee258c14f1289fb10ecc7354067', 'request_id': 'req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:19.637975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a616fee258c14f1289fb10ecc7354067', 'request_id': 'req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:19.650978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] The token cache is being invalidate because project a616fee258c14f1289fb10ecc7354067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:56:19.651500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:19.652218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:19.654170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1176/2381] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:56:19 2022] DELETE /identity/v3/projects/a616fee258c14f1289fb10ecc7354067 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:20.406092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:20.407530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:20.488899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afea3bc-c77b-4a32-b73c-9216ff3abe5e service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:20.560890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e14f4-c86f-4131-b686-a2c607838d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:20.561709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e14f4-c86f-4131-b686-a2c607838d08 service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.561880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e14f4-c86f-4131-b686-a2c607838d08 service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.562209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e14f4-c86f-4131-b686-a2c607838d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.564108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-330e14f4-c86f-4131-b686-a2c607838d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:20.576262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e14f4-c86f-4131-b686-a2c607838d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:20.577859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e14f4-c86f-4131-b686-a2c607838d08 service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:20.589981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1206/2382] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:21.121635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:21.123280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:21.224905 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:21.230447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6a2b-cb97-40f0-b136-0d7077a8fdc8 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:21.236225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:21.237265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:21.237648 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:21.238020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] PATH_INFO: `/v3/users/33ae9e9bad2f450a8c85c6320965b032` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:21.239453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ae9e9bad2f450a8c85c6320965b032)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:21.242043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:21.526051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ae9e9bad2f450a8c85c6320965b032'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:21.526964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ae9e9bad2f450a8c85c6320965b032'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:21.536756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ae9e9bad2f450a8c85c6320965b032'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:21.537825 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ae9e9bad2f450a8c85c6320965b032'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:21.550933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ae9e9bad2f450a8c85c6320965b032'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:21.622025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1177/2383] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:56:21 2022] DELETE /identity/v3/users/33ae9e9bad2f450a8c85c6320965b032 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:21.627453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:21.627987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:21.627987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:21.649246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:21.650501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:21.711649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1207/2384] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:21.721832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:21.723266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:21.783499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae5e38-63f3-4b21-9514-5526752a7800 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:21.787092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197bb2e-af7a-42d6-92a3-048f8bf1902a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:21.787734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197bb2e-af7a-42d6-92a3-048f8bf1902a service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:21.788016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197bb2e-af7a-42d6-92a3-048f8bf1902a service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:21.788288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197bb2e-af7a-42d6-92a3-048f8bf1902a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:21.798287 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197bb2e-af7a-42d6-92a3-048f8bf1902a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:21.799754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197bb2e-af7a-42d6-92a3-048f8bf1902a service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:21.810641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1178/2385] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:56:22.300849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:22.302417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:22.311163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:22.317787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753985-7fa5-47eb-a9ca-5001e5867da8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:22.326297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:22.327387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.327387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.327735 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] PATH_INFO: `/v3/projects/7cbdb5a86a494a4dabc31b843f8fdc19` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.330144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbdb5a86a494a4dabc31b843f8fdc19)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:22.332219 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:22.508764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbdb5a86a494a4dabc31b843f8fdc19', 'request_id': 'req-089fa206-34ba-468c-981b-6828e19d522b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:22.514295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbdb5a86a494a4dabc31b843f8fdc19', 'request_id': 'req-089fa206-34ba-468c-981b-6828e19d522b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:22.592143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbdb5a86a494a4dabc31b843f8fdc19', 'request_id': 'req-089fa206-34ba-468c-981b-6828e19d522b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:22.604895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] The token cache is being invalidate because project 7cbdb5a86a494a4dabc31b843f8fdc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:56:22.605188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:22.605895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-089fa206-34ba-468c-981b-6828e19d522b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:22.607564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1208/2386] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:56:22 2022] DELETE /identity/v3/projects/7cbdb5a86a494a4dabc31b843f8fdc19 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:22.612557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bf4e-bab4-41e7-a7ef-09d0a7f57ce4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.613041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bf4e-bab4-41e7-a7ef-09d0a7f57ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.613134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bf4e-bab4-41e7-a7ef-09d0a7f57ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.634057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-75a5bf4e-bab4-41e7-a7ef-09d0a7f57ce4 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:22.635284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-75a5bf4e-bab4-41e7-a7ef-09d0a7f57ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:22.697990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1179/2387] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:22.706262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64523118-928d-478c-abc7-aaae4756cfa7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.706767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64523118-928d-478c-abc7-aaae4756cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.706884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64523118-928d-478c-abc7-aaae4756cfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.727655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-64523118-928d-478c-abc7-aaae4756cfa7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:22.729004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-64523118-928d-478c-abc7-aaae4756cfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:22.738297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1209/2388] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:22.743289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5bf4e-bab4-41e7-a7ef-09d0a7f57ce4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:22.753212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5bf4e-bab4-41e7-a7ef-09d0a7f57ce4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:22.757912 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:22.758609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.759003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.759235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.760003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:22.760305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:22.761968 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:22.775631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1180/2389] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:22.779893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64523118-928d-478c-abc7-aaae4756cfa7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:22.790151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64523118-928d-478c-abc7-aaae4756cfa7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:22.795495 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:22.796196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.796475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.796751 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.797409 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:22.799333 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.027291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1210/2390] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:56:22 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:23.028318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:23.038762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59ae1-7570-4b53-87d0-f00abd62b583 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:23.042581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:23.105723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:23.106580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.106862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.107134 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.107803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:23.110084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.245096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1181/2391] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:56:23 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:23.248950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:23.260680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a7a5a-f3e8-435c-8d12-a62e9ce178c9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:23.265532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:23.266140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.266421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.266694 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.267347 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:23.269133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.282330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1211/2392] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:56:23.286300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:23.296491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9a35-7b7b-4bf6-89a5-b81850eadef1 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:23.301089 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:23.301695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.302049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.302371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.303023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:23.305406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.322450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1182/2393] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:56:23.326863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:23.339333 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f424-b1f6-44c7-87f3-2b3e4e0742f3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:23.353556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:23.354732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e2eaa-4da8-4a3c-b47d-f028905040b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:23.355132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:23.355507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2eaa-4da8-4a3c-b47d-f028905040b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.355798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2eaa-4da8-4a3c-b47d-f028905040b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.356218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2eaa-4da8-4a3c-b47d-f028905040b2 admin admin] PATH_INFO: `/v3/projects/c5deeb87b4064ef581a0acf5a5de754e/users/5d063e367efa457384e0ba0da1cf5242/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.374210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e2eaa-4da8-4a3c-b47d-f028905040b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5deeb87b4064ef581a0acf5a5de754e, user_id=5d063e367efa457384e0ba0da1cf5242, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:23.377412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e2eaa-4da8-4a3c-b47d-f028905040b2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.382491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6e5d-1258-4a25-82e8-66b8163e9f49 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:23.388545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:23.389286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.389641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.389920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] PATH_INFO: `/v3/users/6649e1e4f7454bcea2a6697b4ece3a43` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.391096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6649e1e4f7454bcea2a6697b4ece3a43)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:23.393054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.465620 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1212/2394] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:56:23 2022] PUT /identity/v3/projects/c5deeb87b4064ef581a0acf5a5de754e/users/5d063e367efa457384e0ba0da1cf5242/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:23.478279 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.478570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.478848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.512283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] MFA Rules not processed for user `5d063e367efa457384e0ba0da1cf5242`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:23.513550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:23.602594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1213/2395] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:56:23.614378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:23.615963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:23.616119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6649e1e4f7454bcea2a6697b4ece3a43'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:23.616710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6649e1e4f7454bcea2a6697b4ece3a43'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:23.624252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6649e1e4f7454bcea2a6697b4ece3a43'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:23.624924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6649e1e4f7454bcea2a6697b4ece3a43'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:23.630058 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:23.639035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6649e1e4f7454bcea2a6697b4ece3a43'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:23.693087 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2afc98-8592-4198-bd0d-b5248b7aeebe None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:23.697006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa60cdb-51d1-4423-b55c-35c5dd00c933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:23.697820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa60cdb-51d1-4423-b55c-35c5dd00c933 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.698257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa60cdb-51d1-4423-b55c-35c5dd00c933 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.698680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa60cdb-51d1-4423-b55c-35c5dd00c933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.701235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-efa60cdb-51d1-4423-b55c-35c5dd00c933 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:23.715985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa60cdb-51d1-4423-b55c-35c5dd00c933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:23.717469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa60cdb-51d1-4423-b55c-35c5dd00c933 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.729564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1214/2396] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:56:23.754765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1183/2397] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:56:23 2022] DELETE /identity/v3/users/6649e1e4f7454bcea2a6697b4ece3a43 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:56:23.758603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.758603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.758603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.781145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:23.782505 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:23.854849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1215/2398] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:23.868129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:23.869697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:23.943211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4c5a-9b49-466b-9c90-3a1a2dfbd3e7 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:23.947888 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27043be8-5401-4b5b-b679-8595d50553f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:23.948525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27043be8-5401-4b5b-b679-8595d50553f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.948809 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27043be8-5401-4b5b-b679-8595d50553f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.949083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27043be8-5401-4b5b-b679-8595d50553f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.959228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27043be8-5401-4b5b-b679-8595d50553f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:23.960726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27043be8-5401-4b5b-b679-8595d50553f5 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:23.971001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:23.973635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1184/2399] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:24.545426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:24.548159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:24.571877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee68336-bf31-4e94-8d53-2125b7de2f14 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:24.591353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:24.591353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.591353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.591353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] PATH_INFO: `/v3/projects/ed7dcde84c3c45858149437467b4d929` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.592092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7dcde84c3c45858149437467b4d929)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:24.592167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:24.729431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7dcde84c3c45858149437467b4d929', 'request_id': 'req-2786ff70-d461-4a9d-ad41-54bb58aace08'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:24.735665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7dcde84c3c45858149437467b4d929', 'request_id': 'req-2786ff70-d461-4a9d-ad41-54bb58aace08'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:24.836577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7dcde84c3c45858149437467b4d929', 'request_id': 'req-2786ff70-d461-4a9d-ad41-54bb58aace08'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:24.853782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] The token cache is being invalidate because project ed7dcde84c3c45858149437467b4d929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:56:24.854296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:24.855379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2786ff70-d461-4a9d-ad41-54bb58aace08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:24.858078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1216/2400] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:56:24 2022] DELETE /identity/v3/projects/ed7dcde84c3c45858149437467b4d929 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:24.863155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617cb9d-ca21-4d6e-a1ec-cf11a6547ec6 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.864798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617cb9d-ca21-4d6e-a1ec-cf11a6547ec6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.864798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617cb9d-ca21-4d6e-a1ec-cf11a6547ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.899301 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-4617cb9d-ca21-4d6e-a1ec-cf11a6547ec6 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:24.900621 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4617cb9d-ca21-4d6e-a1ec-cf11a6547ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:24.973445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1185/2401] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:56:24.982916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0373c-fb70-443c-8589-53f7336822d3 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.983198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0373c-fb70-443c-8589-53f7336822d3 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.983511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0373c-fb70-443c-8589-53f7336822d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.005303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-44e0373c-fb70-443c-8589-53f7336822d3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:25.006528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-44e0373c-fb70-443c-8589-53f7336822d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:25.015118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1217/2402] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:25.019722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617cb9d-ca21-4d6e-a1ec-cf11a6547ec6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.030839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617cb9d-ca21-4d6e-a1ec-cf11a6547ec6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.036366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.036991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.040151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.040151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.040151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:25.040151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.040807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.053709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1186/2403] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:25.059136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0373c-fb70-443c-8589-53f7336822d3 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.068639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0373c-fb70-443c-8589-53f7336822d3 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.074044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.074747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.075026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.075599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.076308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.078348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.180800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1218/2404] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:56:25 2022] POST /identity/v3/projects => generated 399 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:56:25.185733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.197107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f6dd-bcb7-4cc9-8d37-b8ba9f6b4146 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.273503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.274154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.274490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.274933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.276069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.278560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.405316 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1187/2405] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:56:25 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:25.410691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.422731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdfdff-d42f-4221-aaf5-c16a95b93064 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.427605 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.428296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.428582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.428855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.429579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.431264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.433667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.442892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1219/2406] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:56:25.453979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.465112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401e25-0798-4921-8c6e-ae2728e0d887 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.470108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c5b72-33ca-45aa-88ed-5575fedd8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.470766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5b72-33ca-45aa-88ed-5575fedd8a67 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.471047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5b72-33ca-45aa-88ed-5575fedd8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.471543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5b72-33ca-45aa-88ed-5575fedd8a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.472236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c5b72-33ca-45aa-88ed-5575fedd8a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.474083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c5b72-33ca-45aa-88ed-5575fedd8a67 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.487318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1188/2407] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:56:25.491910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.503345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4eb8-2101-457b-9982-8cbb8e0f8e2b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.508220 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.508878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.509158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.509439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] PATH_INFO: `/v3/projects/2a91c6e47e6d487d94e8c823cf2ce547/users/b1ede9cc30134b358a496280a28e26cf/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.525863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a91c6e47e6d487d94e8c823cf2ce547, user_id=b1ede9cc30134b358a496280a28e26cf, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.528704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.655118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1220/2408] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:56:25 2022] PUT /identity/v3/projects/2a91c6e47e6d487d94e8c823cf2ce547/users/b1ede9cc30134b358a496280a28e26cf/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:25.665506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61600f0b-5054-49ec-a890-894e2dda40e9 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.665795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61600f0b-5054-49ec-a890-894e2dda40e9 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.666643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61600f0b-5054-49ec-a890-894e2dda40e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.702273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-61600f0b-5054-49ec-a890-894e2dda40e9 None None] MFA Rules not processed for user `b1ede9cc30134b358a496280a28e26cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:25.703832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-61600f0b-5054-49ec-a890-894e2dda40e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:25.771567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.782459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1189/2409] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:25.794854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.797015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:25.862902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e273-3822-4622-88cd-31f49da0daa4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.867708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.868583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.868881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.869154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.879594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.881267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.890956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1221/2410] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:26.084669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b79341-543e-4688-9014-7f9126ce6db2 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:26.085195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b79341-543e-4688-9014-7f9126ce6db2 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:26.085288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b79341-543e-4688-9014-7f9126ce6db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:26.107068 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-f0b79341-543e-4688-9014-7f9126ce6db2 None None] MFA Rules not processed for user `86c2b496a2c04a0094bf30111bf25669`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:26.108318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f0b79341-543e-4688-9014-7f9126ce6db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:26.178185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1190/2411] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:56:29.322329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:29.323985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:29.413163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d7d16-0373-4289-893f-01194a086bc0 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:29.418740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:29.419562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.419849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.420217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] PATH_INFO: `/v3/users/5d063e367efa457384e0ba0da1cf5242` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:29.421784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d063e367efa457384e0ba0da1cf5242)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:29.424671 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:29.660633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d063e367efa457384e0ba0da1cf5242'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:29.668775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d063e367efa457384e0ba0da1cf5242'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:29.669516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d063e367efa457384e0ba0da1cf5242'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:29.684160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d063e367efa457384e0ba0da1cf5242'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:29.689583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:29.797105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d063e367efa457384e0ba0da1cf5242'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:29.807291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1222/2412] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:56:29 2022] DELETE /identity/v3/users/5d063e367efa457384e0ba0da1cf5242 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:29.812487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.813403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.813403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:29.834270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:29.835841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:29.909694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1191/2413] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:29.919640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:29.921162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:29.986289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbef59-cffe-4bd3-9363-4bebeddc958d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:29.990972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:29.991660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.992476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.992764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:30.004018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:30.005494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:30.016896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1223/2414] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:30.645299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:30.647158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:30.672019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53b508-8e3b-43eb-bd83-c58e0f4079e1 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:30.677159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:30.677818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:30.678108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:30.678390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] PATH_INFO: `/v3/projects/c5deeb87b4064ef581a0acf5a5de754e` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:30.679767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5deeb87b4064ef581a0acf5a5de754e)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:30.681778 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:30.861039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5deeb87b4064ef581a0acf5a5de754e', 'request_id': 'req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:30.867292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5deeb87b4064ef581a0acf5a5de754e', 'request_id': 'req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:30.963688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5deeb87b4064ef581a0acf5a5de754e', 'request_id': 'req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:30.976779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] The token cache is being invalidate because project c5deeb87b4064ef581a0acf5a5de754e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:56:30.977069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:30.977725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3b0c4fd9-00ff-40c7-94da-5213d8e7c430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:30.979244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1192/2415] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:56:30 2022] DELETE /identity/v3/projects/c5deeb87b4064ef581a0acf5a5de754e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:40.401183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:40.402994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:40.415934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b39815-2275-4d6d-8fb5-db3753ae10ed service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:40.475558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:40.476018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.476296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.476569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] PATH_INFO: `/v3/users/b1ede9cc30134b358a496280a28e26cf` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.477720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ede9cc30134b358a496280a28e26cf)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:40.479686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.665907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ede9cc30134b358a496280a28e26cf'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:40.673084 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ede9cc30134b358a496280a28e26cf'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:40.673803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ede9cc30134b358a496280a28e26cf'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:40.686150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ede9cc30134b358a496280a28e26cf'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:40.763913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ede9cc30134b358a496280a28e26cf'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:40.770580 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1224/2416] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:56:40 2022] DELETE /identity/v3/users/b1ede9cc30134b358a496280a28e26cf => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:40.775969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.776529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.776529 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.795892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:40.797119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:40.816133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:40.860898 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1193/2417] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:40.871166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:40.872759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:40.895992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:40.938608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4456-c240-4e37-9ba5-fc345645381b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:40.942490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c02fd-e7cf-4f99-8ce4-c9fc3dd118c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:40.943399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c02fd-e7cf-4f99-8ce4-c9fc3dd118c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.943399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c02fd-e7cf-4f99-8ce4-c9fc3dd118c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.943733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c02fd-e7cf-4f99-8ce4-c9fc3dd118c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.960150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c02fd-e7cf-4f99-8ce4-c9fc3dd118c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:40.962752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c02fd-e7cf-4f99-8ce4-c9fc3dd118c2 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.974124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1225/2418] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:41.508953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:41.510443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:41.522962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c5848-0da2-4367-918a-1fae02e78d55 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:41.532188 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:41.532844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:41.533122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:41.533398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] PATH_INFO: `/v3/projects/2a91c6e47e6d487d94e8c823cf2ce547` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:41.534680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a91c6e47e6d487d94e8c823cf2ce547)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:41.536817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:41.662412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a91c6e47e6d487d94e8c823cf2ce547', 'request_id': 'req-41fded81-0413-459f-8ba0-9f1bac138f31'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:41.667972 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a91c6e47e6d487d94e8c823cf2ce547', 'request_id': 'req-41fded81-0413-459f-8ba0-9f1bac138f31'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:41.758664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a91c6e47e6d487d94e8c823cf2ce547', 'request_id': 'req-41fded81-0413-459f-8ba0-9f1bac138f31'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:41.771689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] The token cache is being invalidate because project 2a91c6e47e6d487d94e8c823cf2ce547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:56:41.771958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:41.772641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-41fded81-0413-459f-8ba0-9f1bac138f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:41.774838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1194/2419] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:56:41 2022] DELETE /identity/v3/projects/2a91c6e47e6d487d94e8c823cf2ce547 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:41.780449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1edf-47fe-46ac-958d-703b95402043 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:41.781396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1edf-47fe-46ac-958d-703b95402043 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:41.781396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1edf-47fe-46ac-958d-703b95402043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:41.802869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-162e1edf-47fe-46ac-958d-703b95402043 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:41.804109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-162e1edf-47fe-46ac-958d-703b95402043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:41.864292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1226/2420] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:41.872837 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fff38-f0bb-4e3d-b4d7-5b574cefc642 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:41.873335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fff38-f0bb-4e3d-b4d7-5b574cefc642 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:41.873432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fff38-f0bb-4e3d-b4d7-5b574cefc642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:41.899511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-b12fff38-f0bb-4e3d-b4d7-5b574cefc642 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:41.900761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b12fff38-f0bb-4e3d-b4d7-5b574cefc642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:41.909109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1195/2421] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:41.913653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e1edf-47fe-46ac-958d-703b95402043 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:41.923511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e1edf-47fe-46ac-958d-703b95402043 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:41.928455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:41.929064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:41.929348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:41.930159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:41.930843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:41.931146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:41.932857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:41.946033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1227/2422] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:41.950515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fff38-f0bb-4e3d-b4d7-5b574cefc642 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:41.960426 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fff38-f0bb-4e3d-b4d7-5b574cefc642 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:41.965361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:41.970223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:41.970223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:41.970223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:41.970223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:41.970223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:42.063054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1196/2423] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:56:41 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:42.067126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:42.077947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858cfd-e5ab-4453-b309-2bb81fc1429c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:42.135374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:42.135987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:42.136267 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:42.136536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:42.137168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:42.139080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:42.272949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1228/2424] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:56:42 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:42.277340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:42.287651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592ab17-9e8e-45e2-b78c-63951906662c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:42.292846 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:42.293457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:42.293842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:42.294010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:42.294661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:42.296300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:42.307548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1197/2425] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:56:42.311698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:42.324144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1daec0-8cf7-404e-8c7f-81d3cdc15024 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:42.330208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee036b1-2ab5-46c9-a8a2-b6999ab9abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:42.330208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee036b1-2ab5-46c9-a8a2-b6999ab9abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:42.330208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee036b1-2ab5-46c9-a8a2-b6999ab9abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:42.330208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee036b1-2ab5-46c9-a8a2-b6999ab9abc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:42.330594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee036b1-2ab5-46c9-a8a2-b6999ab9abc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:42.330594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee036b1-2ab5-46c9-a8a2-b6999ab9abc1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:42.342402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1229/2426] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:56:42.346847 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:42.357965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd259-6ee2-4dbe-bc48-7da5426f411f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:42.362628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:42.363275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:42.363589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:42.363861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] PATH_INFO: `/v3/projects/209bb8eb567b434088d163ae1eafe79c/users/72e153ab64294e518c3ce4ac03077ab8/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:42.379496 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=209bb8eb567b434088d163ae1eafe79c, user_id=72e153ab64294e518c3ce4ac03077ab8, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:42.382138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:42.465386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1198/2427] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:56:42 2022] PUT /identity/v3/projects/209bb8eb567b434088d163ae1eafe79c/users/72e153ab64294e518c3ce4ac03077ab8/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:56:42.470641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6376e1-2fa1-473e-adde-2c0a44e0414f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:42.470911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6376e1-2fa1-473e-adde-2c0a44e0414f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:42.471205 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6376e1-2fa1-473e-adde-2c0a44e0414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:42.495034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-3f6376e1-2fa1-473e-adde-2c0a44e0414f None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:42.496327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3f6376e1-2fa1-473e-adde-2c0a44e0414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:42.518665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:42.563002 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1230/2428] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:56:42.572799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:42.574334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:42.625530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:42.636235 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe699e5-9f63-4786-91bc-1cd2961a7c3c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:42.640115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:42.640591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:42.640870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:42.641143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:42.651561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:42.653000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:42.662582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1199/2429] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:48.544159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b7ff-4767-4983-8c40-2d22547a9bf5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:48.553554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b7ff-4767-4983-8c40-2d22547a9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:48.553554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b7ff-4767-4983-8c40-2d22547a9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:48.593305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ab86b7ff-4767-4983-8c40-2d22547a9bf5 None None] MFA Rules not processed for user `72e153ab64294e518c3ce4ac03077ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:48.594769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ab86b7ff-4767-4983-8c40-2d22547a9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:48.679527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1231/2430] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:48.683973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:48.697609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ed48-9f4a-470f-a62c-8a39892f56d2 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:48.702715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:48.703494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:48.703792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:48.704070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:48.704812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:48.707413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:48.869978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1200/2431] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:56:48 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:48.874291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b7ff-4767-4983-8c40-2d22547a9bf5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:48.894234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b7ff-4767-4983-8c40-2d22547a9bf5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:48.971394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:48.972178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:48.972518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:48.972878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:48.973604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:48.975878 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.163060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1232/2432] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:56:48 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:56:49.167520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.179249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8a3d-f64c-4707-bc76-37fa25504532 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.184465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.185102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.185386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.185662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.186326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.187990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.200602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1201/2433] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:56:49.204691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.217498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c53b7-5f0a-4531-ac18-d19a772ae49b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.222497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.223159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.223498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.223989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] PATH_INFO: `/v3/projects/36221a3e487d4217b763372469a60596/users/42eeaf7c558b4d50b84d7f155a812f77/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.241598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36221a3e487d4217b763372469a60596, user_id=42eeaf7c558b4d50b84d7f155a812f77, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.244396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.371855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1233/2434] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:56:49 2022] PUT /identity/v3/projects/36221a3e487d4217b763372469a60596/users/42eeaf7c558b4d50b84d7f155a812f77/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:49.376532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.389143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a03a4-b0d9-41ab-b7d3-bc588c52a538 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.465838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8b3eb-fd81-43a6-8c1e-13e5859ccbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.466455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8b3eb-fd81-43a6-8c1e-13e5859ccbab admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.466732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8b3eb-fd81-43a6-8c1e-13e5859ccbab admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.466999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8b3eb-fd81-43a6-8c1e-13e5859ccbab admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.467678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8b3eb-fd81-43a6-8c1e-13e5859ccbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.469293 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8b3eb-fd81-43a6-8c1e-13e5859ccbab admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.480149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1202/2435] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:56:49.484504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.497033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eec3ee-5cc7-4e45-9aa6-f2bf4304c934 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.502679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.503514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.503944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.508909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] PATH_INFO: `/v3/projects/36221a3e487d4217b763372469a60596/users/42eeaf7c558b4d50b84d7f155a812f77/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.508909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36221a3e487d4217b763372469a60596, user_id=42eeaf7c558b4d50b84d7f155a812f77, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.509673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.523068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1234/2436] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:56:49 2022] PUT /identity/v3/projects/36221a3e487d4217b763372469a60596/users/42eeaf7c558b4d50b84d7f155a812f77/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:56.403718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:56.404587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:56.405041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:56.440183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] MFA Rules not processed for user `42eeaf7c558b4d50b84d7f155a812f77`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:56.441525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:56.525490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1203/2437] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:56.540098 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:56.541954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:56.555477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:56.640380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9902f-10ca-424f-aeff-3b1559f614e0 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:56.646349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26e5b7-0ac2-448c-9381-d6a94f04e273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:56.646984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e5b7-0ac2-448c-9381-d6a94f04e273 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:56.647581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e5b7-0ac2-448c-9381-d6a94f04e273 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:56.647866 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e5b7-0ac2-448c-9381-d6a94f04e273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:56.723651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26e5b7-0ac2-448c-9381-d6a94f04e273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:56.725261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26e5b7-0ac2-448c-9381-d6a94f04e273 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:56.747768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1235/2438] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:58.555902 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:58.557444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:58.605686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:58.631129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f956-51da-4c94-8d60-c427598fa898 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:58.635948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:58.636720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:58.636936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:58.637212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] PATH_INFO: `/v3/users/e04ed5fe1db543438c3a9aac33d00b3a` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:58.638351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04ed5fe1db543438c3a9aac33d00b3a)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:58.640307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:58.904437 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04ed5fe1db543438c3a9aac33d00b3a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:58.905016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04ed5fe1db543438c3a9aac33d00b3a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:58.912428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04ed5fe1db543438c3a9aac33d00b3a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:58.913127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04ed5fe1db543438c3a9aac33d00b3a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:58.926303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04ed5fe1db543438c3a9aac33d00b3a'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:56:59.056436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1204/2439] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 20:56:58 2022] DELETE /identity/v3/users/e04ed5fe1db543438c3a9aac33d00b3a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:59.060902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:59.061408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:59.061527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:59.080688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:59.081925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:59.151924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1236/2440] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:56:59.162590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:59.164702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:59.223427 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36190d2-e841-4c0b-8d01-26a2e1376adc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:59.227849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52918d2-204e-4dec-9544-a9151547c54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:59.228504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52918d2-204e-4dec-9544-a9151547c54d service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:59.233015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52918d2-204e-4dec-9544-a9151547c54d service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:59.233015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52918d2-204e-4dec-9544-a9151547c54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:59.238393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52918d2-204e-4dec-9544-a9151547c54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:59.239889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52918d2-204e-4dec-9544-a9151547c54d service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:59.249562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1205/2441] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:56:59.826972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:59.828496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:59.845746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87769f-2852-4847-a9e8-ed0f90e2c170 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:59.852508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:59.853452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:59.853893 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:59.854512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] PATH_INFO: `/v3/projects/bb2bee8abaaf45bd8f0dd6361cbf589c` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:59.856048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2bee8abaaf45bd8f0dd6361cbf589c)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:59.858921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:59.990938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:59.997875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2bee8abaaf45bd8f0dd6361cbf589c', 'request_id': 'req-7ddd54a0-87d3-4341-a086-3748bd969b49'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:57:00.004464 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2bee8abaaf45bd8f0dd6361cbf589c', 'request_id': 'req-7ddd54a0-87d3-4341-a086-3748bd969b49'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:57:00.113184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2bee8abaaf45bd8f0dd6361cbf589c', 'request_id': 'req-7ddd54a0-87d3-4341-a086-3748bd969b49'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:57:00.127644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e01f6-ffd1-417e-b9b6-55aa8ac613cf None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.128154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e01f6-ffd1-417e-b9b6-55aa8ac613cf None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.128252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e01f6-ffd1-417e-b9b6-55aa8ac613cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.139816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] The token cache is being invalidate because project bb2bee8abaaf45bd8f0dd6361cbf589c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 20:57:00.140379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:57:00.141381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7ddd54a0-87d3-4341-a086-3748bd969b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 20:57:00.145247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1237/2442] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 20:56:59 2022] DELETE /identity/v3/projects/bb2bee8abaaf45bd8f0dd6361cbf589c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:57:00.150120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899b37-953f-46ec-8c7e-e619f7fb1b82 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.150377 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8b7e01f6-ffd1-417e-b9b6-55aa8ac613cf None None] MFA Rules not processed for user `72e153ab64294e518c3ce4ac03077ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:00.150725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899b37-953f-46ec-8c7e-e619f7fb1b82 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.151390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899b37-953f-46ec-8c7e-e619f7fb1b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.152128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8b7e01f6-ffd1-417e-b9b6-55aa8ac613cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:00.186166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1f899b37-953f-46ec-8c7e-e619f7fb1b82 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:00.187702 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1f899b37-953f-46ec-8c7e-e619f7fb1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:00.231145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1206/2443] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:57:00.309574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1238/2444] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:00.315949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d839-08d6-4c74-9998-8100e4f5bfc3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.316546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d839-08d6-4c74-9998-8100e4f5bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.317059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d839-08d6-4c74-9998-8100e4f5bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.326330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:00.341961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-2801d839-08d6-4c74-9998-8100e4f5bfc3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:00.347516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2801d839-08d6-4c74-9998-8100e4f5bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:00.364988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1207/2445] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:57:00.366225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f899b37-953f-46ec-8c7e-e619f7fb1b82 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.377978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f899b37-953f-46ec-8c7e-e619f7fb1b82 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.385172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.386398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.386779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.387156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.388173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:57:00.388583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.390582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.409462 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1239/2446] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 20:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:57:00.410440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d839-08d6-4c74-9998-8100e4f5bfc3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.421247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d839-08d6-4c74-9998-8100e4f5bfc3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.427922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.428668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.428963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.429317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.430067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.432216 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.528407 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1208/2447] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:57:00 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:57:00.530225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.542366 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074d78-1175-4bc3-9657-c9c686aea5a8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.608345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.608961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.609241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.609514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.610241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.612150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.696650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1240/2448] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:57:00 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:57:00.700957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.713428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa97be-9c8d-4d94-a0eb-c0dcb570d64c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.719114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.719785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.720066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.720334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.721008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.722631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.739000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1209/2449] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:57:00.740262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.751481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7460568-aaa5-4c9d-8526-c8de3c561e04 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.756898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8793bb2-2037-4cbd-acd0-3b19f2c89080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.757515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793bb2-2037-4cbd-acd0-3b19f2c89080 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.757816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793bb2-2037-4cbd-acd0-3b19f2c89080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.758093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793bb2-2037-4cbd-acd0-3b19f2c89080 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.758760 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8793bb2-2037-4cbd-acd0-3b19f2c89080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.760447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8793bb2-2037-4cbd-acd0-3b19f2c89080 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.772110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1241/2450] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:57:00.777505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.789978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30621a1e-6f6d-454d-b01c-85aeaa96dd7b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.795380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.796581 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.797091 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.797591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] PATH_INFO: `/v3/projects/3ed3d374c7a145918d9ad3b770cb562b/users/d87dd0b10a4a4db39935df509bc8eb0b/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.820027 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3d374c7a145918d9ad3b770cb562b, user_id=d87dd0b10a4a4db39935df509bc8eb0b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.823396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:01.014371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1210/2451] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:57:00 2022] PUT /identity/v3/projects/3ed3d374c7a145918d9ad3b770cb562b/users/d87dd0b10a4a4db39935df509bc8eb0b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:57:01.017065 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93bbb0-69af-406b-8192-729fa42604a7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:01.017383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93bbb0-69af-406b-8192-729fa42604a7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:01.017659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93bbb0-69af-406b-8192-729fa42604a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:01.038183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9e93bbb0-69af-406b-8192-729fa42604a7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:01.039440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9e93bbb0-69af-406b-8192-729fa42604a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:01.072498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:01.105538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1242/2452] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:01.115983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:01.118010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:01.198716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f519c66-b754-48ff-8b9b-ee307b0723e6 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:01.203270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:01.204220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:01.204514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:01.204862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:01.220420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:01.223045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:01.260163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1211/2453] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:07.268787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ed49e-e59d-4c36-be59-c04dbb758b7e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:07.269322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ed49e-e59d-4c36-be59-c04dbb758b7e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:07.269322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ed49e-e59d-4c36-be59-c04dbb758b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:07.299669 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-425ed49e-e59d-4c36-be59-c04dbb758b7e None None] MFA Rules not processed for user `d87dd0b10a4a4db39935df509bc8eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:07.300894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-425ed49e-e59d-4c36-be59-c04dbb758b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:07.394581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1243/2454] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:07.399353 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:07.409242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e968e-4b4a-4c0e-be37-594e7be8d0a9 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:07.415210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:07.417881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:07.417881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:07.417881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:07.418186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:07.422127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:07.528148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1212/2455] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 20:57:07 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:57:07.529712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ed49e-e59d-4c36-be59-c04dbb758b7e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:07.544192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ed49e-e59d-4c36-be59-c04dbb758b7e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:07.612024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:07.612815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:07.613106 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:07.613381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:07.614021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:07.616046 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:07.703547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1244/2456] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 20:57:07 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:57:07.712602 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:07.728289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f723-d610-424f-9f75-b7609f4aac28 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:07.735738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:07.736436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:07.736718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:07.737016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:07.737670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:07.739338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:07.751042 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1213/2457] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:57:07.755483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:07.768223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649819f5-ae47-4579-a0f5-52e1a8a486ba admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:07.774619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:07.775280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:07.775589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:07.775869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] PATH_INFO: `/v3/projects/2f85fc72536b48e5967f99ffc72c1e09/users/b824788c02e446b6b826443c36539740/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:07.794647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f85fc72536b48e5967f99ffc72c1e09, user_id=b824788c02e446b6b826443c36539740, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:07.797436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:07.893961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1245/2458] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:57:07 2022] PUT /identity/v3/projects/2f85fc72536b48e5967f99ffc72c1e09/users/b824788c02e446b6b826443c36539740/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:57:07.898628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:07.911108 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add93b7b-42e9-4693-96f7-c02007c15f44 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:07.981102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a06b3-cde9-41f8-88c0-c9c5185cb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:07.981717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a06b3-cde9-41f8-88c0-c9c5185cb598 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:07.981994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a06b3-cde9-41f8-88c0-c9c5185cb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:07.982269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a06b3-cde9-41f8-88c0-c9c5185cb598 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:07.982924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a06b3-cde9-41f8-88c0-c9c5185cb598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:07.984614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a06b3-cde9-41f8-88c0-c9c5185cb598 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:07.995178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1214/2459] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:57:07.999681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:08.010788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f635d0-baf9-4489-9a7c-2bc9dbfc55a0 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:08.016238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:08.016972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:08.017284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:08.017572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] PATH_INFO: `/v3/projects/2f85fc72536b48e5967f99ffc72c1e09/users/b824788c02e446b6b826443c36539740/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:08.019773 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f85fc72536b48e5967f99ffc72c1e09, user_id=b824788c02e446b6b826443c36539740, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:08.022990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:08.035003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1246/2460] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 20:57:07 2022] PUT /identity/v3/projects/2f85fc72536b48e5967f99ffc72c1e09/users/b824788c02e446b6b826443c36539740/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:57:13.994676 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c6c3-b195-4342-a992-802b02dac380 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:13.995920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c6c3-b195-4342-a992-802b02dac380 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:13.996197 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c6c3-b195-4342-a992-802b02dac380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:14.004631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:14.033061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d991c6c3-b195-4342-a992-802b02dac380 None None] MFA Rules not processed for user `b824788c02e446b6b826443c36539740`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:14.033061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d991c6c3-b195-4342-a992-802b02dac380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:14.136900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1215/2461] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:14.150647 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:14.152568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:14.177923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:14.221469 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0ae2-0c79-45fa-8286-70dd0dabae63 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:14.225442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:14.226067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:14.226352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:14.227541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:14.288413 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:14.290456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:14.300329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1247/2462] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:14.615491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb9f2-41cb-40a2-941c-cc284a2386f4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:14.616085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb9f2-41cb-40a2-941c-cc284a2386f4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:14.616649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cb9f2-41cb-40a2-941c-cc284a2386f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:14.639896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-861cb9f2-41cb-40a2-941c-cc284a2386f4 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:14.641242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-861cb9f2-41cb-40a2-941c-cc284a2386f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:14.724024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1216/2463] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:14.896146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:14.897642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:14.974714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb04f-1158-40fd-b6ce-117ba59e4ea6 service glance] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:14.980168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680c31-6902-4d2f-90a2-dec653924871 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:14.981251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680c31-6902-4d2f-90a2-dec653924871 service swift] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:14.981607 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680c31-6902-4d2f-90a2-dec653924871 service swift] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:14.981948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680c31-6902-4d2f-90a2-dec653924871 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:14.993519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680c31-6902-4d2f-90a2-dec653924871 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:14.996285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680c31-6902-4d2f-90a2-dec653924871 service swift] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:15.027529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1248/2464] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:57:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:57:24.711553 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=57 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:25.003505 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=72 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:26.826242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82777d3-bcec-4acf-85dd-fb99536dc458 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:26.826817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82777d3-bcec-4acf-85dd-fb99536dc458 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:26.826817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82777d3-bcec-4acf-85dd-fb99536dc458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:26.846486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a82777d3-bcec-4acf-85dd-fb99536dc458 None None] MFA Rules not processed for user `d87dd0b10a4a4db39935df509bc8eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:26.847744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a82777d3-bcec-4acf-85dd-fb99536dc458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:26.856256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1217/2465] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:28.119704 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c194b-f9d2-4b6a-9d3a-931644b955b8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:28.120178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c194b-f9d2-4b6a-9d3a-931644b955b8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:28.120265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c194b-f9d2-4b6a-9d3a-931644b955b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:28.142535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ac2c194b-f9d2-4b6a-9d3a-931644b955b8 None None] MFA Rules not processed for user `b5b5dd3c92034837921826c9b2dea76b`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:28.147526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ac2c194b-f9d2-4b6a-9d3a-931644b955b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:28.205635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1249/2466] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:31.918895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:31.921975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:31.921975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:31.938662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:31.939895 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:31.947781 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1218/2467] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:31.960126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c194b-f9d2-4b6a-9d3a-931644b955b8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:31.984830 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c194b-f9d2-4b6a-9d3a-931644b955b8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:31.989923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:31.990547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:31.990894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:31.991140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:32.000579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:32.002286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:32.012423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1250/2468] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:57:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:57:41.933170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:42.007449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=31 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:06.883237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:06.890107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:06.946357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4633d4-2b78-4cc1-9162-d9a7e62ff592 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:06.949966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:06.950574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:06.950856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:06.951133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:06.953044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:07.023692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:07.025401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:07.042014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1219/2469] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:09.205335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:09.216078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6753fcd-f2a1-4a3a-8a65-629a5d4d4584 service swift] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:09.221137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:09.221968 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:09.222245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:09.222683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:09.224832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:09.300911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:09.306560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:09.314643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1251/2470] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:14.196705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:14.206622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57853e27-7334-4565-ade7-389b560863e1 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:14.210242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:14.210943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:14.211157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:14.211433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:14.213133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:14.227577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:14.228990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:14.240882 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1220/2471] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:17.176810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:17.185477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650b8b-a93e-47c8-b589-a324ac2da898 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:17.189184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841daaa-0393-4479-83b5-c1a3720361ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:17.189794 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841daaa-0393-4479-83b5-c1a3720361ef service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:17.190109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841daaa-0393-4479-83b5-c1a3720361ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:17.190403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841daaa-0393-4479-83b5-c1a3720361ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:17.199456 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841daaa-0393-4479-83b5-c1a3720361ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:17.200953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841daaa-0393-4479-83b5-c1a3720361ef service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:17.211014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1252/2472] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:24.235438 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=60 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:27.207407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=36 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:36.643106 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:36.644570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:36.658959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7952a7-6a2e-423a-9534-1729a93c685a service glance] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:36.665284 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:36.665870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:36.666150 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:36.666424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:36.668143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:36.726154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:36.727764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:36.737028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1221/2473] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:41.286125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c4b6-1682-43b9-b217-7ea80381a63e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:41.286650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c4b6-1682-43b9-b217-7ea80381a63e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:41.286650 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c4b6-1682-43b9-b217-7ea80381a63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:41.307689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-cfa6c4b6-1682-43b9-b217-7ea80381a63e None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:41.308944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cfa6c4b6-1682-43b9-b217-7ea80381a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:41.316257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1253/2474] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:41.358718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:41.370640 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8ab4-f16e-4501-8dc2-66c2495c6afe service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:41.375818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:41.376423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:41.376704 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:41.376978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:41.388899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:41.390455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:41.398784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1222/2475] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:58:47.000534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6c4b6-1682-43b9-b217-7ea80381a63e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:47.016111 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6c4b6-1682-43b9-b217-7ea80381a63e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:47.021985 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f9318-24ad-4e05-8879-c6f22f6ab73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:47.023212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9318-24ad-4e05-8879-c6f22f6ab73c service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:47.023934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9318-24ad-4e05-8879-c6f22f6ab73c service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:47.024243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9318-24ad-4e05-8879-c6f22f6ab73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:47.029953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c27f9318-24ad-4e05-8879-c6f22f6ab73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:47.044490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f9318-24ad-4e05-8879-c6f22f6ab73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:47.047981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f9318-24ad-4e05-8879-c6f22f6ab73c service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:47.071484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1254/2476] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:51.395444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=34 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:57.059463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=9 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:59.053191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:59.063019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed9ea-593c-43cd-8e9a-65804e38cb05 service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:59.066609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29eb65-2f8f-487c-8ad5-e3b5aeea13f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:59.067229 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29eb65-2f8f-487c-8ad5-e3b5aeea13f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.067537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29eb65-2f8f-487c-8ad5-e3b5aeea13f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.067803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29eb65-2f8f-487c-8ad5-e3b5aeea13f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.069501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fc29eb65-2f8f-487c-8ad5-e3b5aeea13f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:59.079734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29eb65-2f8f-487c-8ad5-e3b5aeea13f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:59.081143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29eb65-2f8f-487c-8ad5-e3b5aeea13f6 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:59.088929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1223/2477] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:59.595801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c194-0f31-428a-8601-5b082ba08c8b None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.596408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c194-0f31-428a-8601-5b082ba08c8b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.596408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c194-0f31-428a-8601-5b082ba08c8b None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.597787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1255/2478] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:59.604485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eda62e-c20a-4088-b170-176949bd9189 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.604769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eda62e-c20a-4088-b170-176949bd9189 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.605047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eda62e-c20a-4088-b170-176949bd9189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.625504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-14eda62e-c20a-4088-b170-176949bd9189 None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:59.626789 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-14eda62e-c20a-4088-b170-176949bd9189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:59.636227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1224/2479] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:59.648291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202c194-0f31-428a-8601-5b082ba08c8b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:59.660206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202c194-0f31-428a-8601-5b082ba08c8b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:59.663888 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308331d-3b6a-49fd-be7f-ac4d84cbd171 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:59.664452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308331d-3b6a-49fd-be7f-ac4d84cbd171 service glance] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.664734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308331d-3b6a-49fd-be7f-ac4d84cbd171 service glance] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.665019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308331d-3b6a-49fd-be7f-ac4d84cbd171 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.675340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308331d-3b6a-49fd-be7f-ac4d84cbd171 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:59.676793 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308331d-3b6a-49fd-be7f-ac4d84cbd171 service glance] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:59.688245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1256/2480] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:59.923494 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341f06-cd1f-4bd5-a1c1-f18c8c0fda79 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.923779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341f06-cd1f-4bd5-a1c1-f18c8c0fda79 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.924055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341f06-cd1f-4bd5-a1c1-f18c8c0fda79 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.925410 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1225/2481] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:59.929941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a12e-3a4c-4b4b-a5ad-612727a5aeaa None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.930227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a12e-3a4c-4b4b-a5ad-612727a5aeaa None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.930536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a12e-3a4c-4b4b-a5ad-612727a5aeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.952184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-70a0a12e-3a4c-4b4b-a5ad-612727a5aeaa None None] MFA Rules not processed for user `162eb7d6a9894e4ca60aa8da4537a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:59.953425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-70a0a12e-3a4c-4b4b-a5ad-612727a5aeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:59.959955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1257/2482] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:59.971697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40341f06-cd1f-4bd5-a1c1-f18c8c0fda79 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:59.982622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40341f06-cd1f-4bd5-a1c1-f18c8c0fda79 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:59.986160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e63b11-4e9f-4ecc-98d8-2662ad4e0b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:59.986743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e63b11-4e9f-4ecc-98d8-2662ad4e0b09 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:59.987069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e63b11-4e9f-4ecc-98d8-2662ad4e0b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:59.987340 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e63b11-4e9f-4ecc-98d8-2662ad4e0b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:59.994304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e63b11-4e9f-4ecc-98d8-2662ad4e0b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:59.995741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e63b11-4e9f-4ecc-98d8-2662ad4e0b09 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.003936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1226/2483] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:00.092802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4e230-66e7-476b-879e-9a9b220c2753 None None] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.093130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4e230-66e7-476b-879e-9a9b220c2753 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.093468 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4e230-66e7-476b-879e-9a9b220c2753 None None] PATH_INFO: `/` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.095004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1258/2484] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 20:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:00.100253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.100728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.100834 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.120646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:00.122516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.132214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1227/2485] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:00.142957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4e230-66e7-476b-879e-9a9b220c2753 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.154263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4e230-66e7-476b-879e-9a9b220c2753 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.157945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cd084-379c-4ee1-948d-306db76b6b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.158541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cd084-379c-4ee1-948d-306db76b6b99 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.159015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cd084-379c-4ee1-948d-306db76b6b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.159288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cd084-379c-4ee1-948d-306db76b6b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.171109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cd084-379c-4ee1-948d-306db76b6b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.172612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cd084-379c-4ee1-948d-306db76b6b99 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.185000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1259/2486] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:00.254029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:00.255503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.325099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d975d-d7ce-4038-9202-21aa818e54e3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:00.330326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:00.331056 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.331329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.331629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.333358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.345014 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:00.346618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:00.358638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1228/2487] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:06.472730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e11a8-4fb7-486b-85b9-d1a6771fcac8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:06.473246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e11a8-4fb7-486b-85b9-d1a6771fcac8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:06.473354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e11a8-4fb7-486b-85b9-d1a6771fcac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:06.492170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e32e11a8-4fb7-486b-85b9-d1a6771fcac8 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:06.493362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e32e11a8-4fb7-486b-85b9-d1a6771fcac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:06.500988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1260/2488] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:06.514295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:06.525745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bce9e-a357-4f43-8301-9ee8ac01e76e service placement] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:06.531066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:06.531689 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:06.531970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:06.532242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:06.540259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:06.541828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:06.549889 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1229/2489] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:59:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:59:16.487470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=18 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:16.546540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=56 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:23.954177 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f512b-8bf9-4768-ac6e-1f9a10d601cd None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:23.954747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f512b-8bf9-4768-ac6e-1f9a10d601cd None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:23.954747 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f512b-8bf9-4768-ac6e-1f9a10d601cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:23.974493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7d0f512b-8bf9-4768-ac6e-1f9a10d601cd None None] MFA Rules not processed for user `86c2b496a2c04a0094bf30111bf25669`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:23.975733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7d0f512b-8bf9-4768-ac6e-1f9a10d601cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:23.982574 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1261/2490] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:31.847592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:31.849366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:31.866288 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33de04-4ce7-4ae4-b060-85be771a3324 service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:31.872343 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fc43f-9f71-4e5c-9290-0a9a6577d813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:31.875355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fc43f-9f71-4e5c-9290-0a9a6577d813 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:31.875355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fc43f-9f71-4e5c-9290-0a9a6577d813 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:31.875355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fc43f-9f71-4e5c-9290-0a9a6577d813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:31.875836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-780fc43f-9f71-4e5c-9290-0a9a6577d813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:31.888920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fc43f-9f71-4e5c-9290-0a9a6577d813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:31.890625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fc43f-9f71-4e5c-9290-0a9a6577d813 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:31.902109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1230/2491] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:33.969313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:36.781571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f512b-8bf9-4768-ac6e-1f9a10d601cd None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:36.794651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f512b-8bf9-4768-ac6e-1f9a10d601cd None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:36.800711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:36.801300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:36.801577 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:36.801950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:36.803696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:36.816406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:36.825757 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:36.828969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1262/2492] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:39.303191 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82a77-b6ca-490b-a118-f18541ea70bb None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:39.303685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82a77-b6ca-490b-a118-f18541ea70bb None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:39.303795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82a77-b6ca-490b-a118-f18541ea70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:39.322742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7cc82a77-b6ca-490b-a118-f18541ea70bb None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:39.323971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7cc82a77-b6ca-490b-a118-f18541ea70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:39.331153 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1231/2493] 10.222.0.62 () {58 vars in 967 bytes} [Thu Aug 18 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:39.343188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:39.355005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789b1a0-f8d9-4975-9767-731449ccc709 service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:39.359889 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:39.360486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:39.360762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:39.361032 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:39.369805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:39.371405 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:39.379591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1263/2494] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 20:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:59:49.317652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=9 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:49.376299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=12 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:54.155548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82a77-b6ca-490b-a118-f18541ea70bb None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:54.169023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82a77-b6ca-490b-a118-f18541ea70bb None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:54.174580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1d51c-b386-46d5-8ea7-bf9a3a8cebdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:54.175193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d51c-b386-46d5-8ea7-bf9a3a8cebdb service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:54.175512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d51c-b386-46d5-8ea7-bf9a3a8cebdb service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:54.175785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d51c-b386-46d5-8ea7-bf9a3a8cebdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:54.177527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-cfb1d51c-b386-46d5-8ea7-bf9a3a8cebdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:54.188620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1d51c-b386-46d5-8ea7-bf9a3a8cebdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:54.190249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1d51c-b386-46d5-8ea7-bf9a3a8cebdb service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:54.200203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1232/2495] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:58.131924 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:58.144681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8995d5-12da-4ea1-b624-b604219b8cf2 service swift] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:58.150811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:58.151447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:58.151730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:58.152016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:58.154653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:58.167965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:58.172700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:58.181517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1264/2496] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:04.195258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:08.176126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:11.325838 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8d58-1862-496c-93bf-24b62cf8c571 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:11.326360 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8d58-1862-496c-93bf-24b62cf8c571 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:11.326485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8d58-1862-496c-93bf-24b62cf8c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:11.345634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-576a8d58-1862-496c-93bf-24b62cf8c571 None None] MFA Rules not processed for user `b5b5dd3c92034837921826c9b2dea76b`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:11.346891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-576a8d58-1862-496c-93bf-24b62cf8c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:11.355399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1233/2497] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:21.340588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:48.458400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:48.470216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfdb86-994d-42a3-a7d7-54ec2d22558b service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:48.476584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038450e4-6443-4757-a458-6e6e567701df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:48.477195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038450e4-6443-4757-a458-6e6e567701df service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:48.477475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038450e4-6443-4757-a458-6e6e567701df service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:48.477748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038450e4-6443-4757-a458-6e6e567701df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:48.479633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-038450e4-6443-4757-a458-6e6e567701df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:48.555815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038450e4-6443-4757-a458-6e6e567701df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:48.557430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038450e4-6443-4757-a458-6e6e567701df service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:48.570687 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1265/2498] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:58.562600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=28 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:00.925198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501fc42-bc12-4964-a47e-c614d673cf28 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:00.925771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501fc42-bc12-4964-a47e-c614d673cf28 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:00.925771 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501fc42-bc12-4964-a47e-c614d673cf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:00.944273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8501fc42-bc12-4964-a47e-c614d673cf28 None None] MFA Rules not processed for user `cf3712f97958438581b8e153723a1d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:00.946534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8501fc42-bc12-4964-a47e-c614d673cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:00.952892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1234/2499] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:01.328474 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038450e4-6443-4757-a458-6e6e567701df service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:01.338161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038450e4-6443-4757-a458-6e6e567701df service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:01.342192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:01.342846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:01.343137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:01.343445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:01.345394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:01.355848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:01.357284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:01.365371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1266/2500] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:01:02.133800 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501fc42-bc12-4964-a47e-c614d673cf28 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:02.143635 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501fc42-bc12-4964-a47e-c614d673cf28 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:02.147652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:02.148925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:02.149305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:02.149667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:02.151533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:02.224906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:02.226901 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:02.237031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1235/2501] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:01:07.313113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:07.314721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:07.433898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e380-be7d-4992-9c82-9b404c9db1b5 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:07.441324 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:07.442208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:07.442665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:07.443188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:07.446387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:07.468473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:07.472921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:07.487231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:07.489138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:07.512158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1267/2502] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:01:07.615614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5cb67-6db5-44df-8a62-75e5c7864a83 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:07.621022 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:07.621876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:07.622281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:07.622566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] PATH_INFO: `/v3/users/86c2b496a2c04a0094bf30111bf25669` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:07.623836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c2b496a2c04a0094bf30111bf25669)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:07.625903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:07.798768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c2b496a2c04a0094bf30111bf25669'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:07.799981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c2b496a2c04a0094bf30111bf25669'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:07.807253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c2b496a2c04a0094bf30111bf25669'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:07.808009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c2b496a2c04a0094bf30111bf25669'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:07.821228 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-359afd00-6415-4906-86c5-6960353fa9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c2b496a2c04a0094bf30111bf25669'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:07.916756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:07.922052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1236/2503] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:01:07 2022] DELETE /identity/v3/users/86c2b496a2c04a0094bf30111bf25669 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:01:08.209490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:08.223779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3b46-cb29-4dc2-a231-c7ad2a138526 service placement] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:08.313800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:08.314588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.314879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.315155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] PATH_INFO: `/v3/projects/119af0f155d0477cbc4a15a054070278` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.316351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] RBAC: Authorizing `identity:delete_project(project_id=119af0f155d0477cbc4a15a054070278)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:08.318724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:08.443057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119af0f155d0477cbc4a15a054070278', 'request_id': 'req-a24bb87a-8e64-43dd-a282-e341b9d2724a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:08.449826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119af0f155d0477cbc4a15a054070278', 'request_id': 'req-a24bb87a-8e64-43dd-a282-e341b9d2724a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:08.550117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119af0f155d0477cbc4a15a054070278', 'request_id': 'req-a24bb87a-8e64-43dd-a282-e341b9d2724a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:08.552419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:08.563038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] The token cache is being invalidate because project 119af0f155d0477cbc4a15a054070278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:01:08.563330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:08.564060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a24bb87a-8e64-43dd-a282-e341b9d2724a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:08.565482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1268/2504] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:01:08 2022] DELETE /identity/v3/projects/119af0f155d0477cbc4a15a054070278 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:08.571519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1831-a057-44e0-9fe9-64c827ea2a57 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.572018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1831-a057-44e0-9fe9-64c827ea2a57 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.572135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1831-a057-44e0-9fe9-64c827ea2a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.636516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-59ba1831-a057-44e0-9fe9-64c827ea2a57 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:08.637725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-59ba1831-a057-44e0-9fe9-64c827ea2a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:08.699467 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1237/2505] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:08.712254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19425-eb48-4c44-bfe0-e6ef8d7aa386 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.713538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19425-eb48-4c44-bfe0-e6ef8d7aa386 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.713538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19425-eb48-4c44-bfe0-e6ef8d7aa386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.740164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-cfa19425-eb48-4c44-bfe0-e6ef8d7aa386 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:08.741535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cfa19425-eb48-4c44-bfe0-e6ef8d7aa386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:08.750547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1269/2506] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:08.755030 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba1831-a057-44e0-9fe9-64c827ea2a57 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:08.765332 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba1831-a057-44e0-9fe9-64c827ea2a57 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:08.770046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eff78-2e7a-45d0-8e3a-ff1c9ce8fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:08.770651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eff78-2e7a-45d0-8e3a-ff1c9ce8fdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.770936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eff78-2e7a-45d0-8e3a-ff1c9ce8fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.771234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eff78-2e7a-45d0-8e3a-ff1c9ce8fdf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.771963 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eff78-2e7a-45d0-8e3a-ff1c9ce8fdf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:08.775910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eff78-2e7a-45d0-8e3a-ff1c9ce8fdf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:08.775910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eff78-2e7a-45d0-8e3a-ff1c9ce8fdf9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:08.786904 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1238/2507] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:01:08.791890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa19425-eb48-4c44-bfe0-e6ef8d7aa386 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:08.801192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa19425-eb48-4c44-bfe0-e6ef8d7aa386 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:08.807174 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:08.814182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.814182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.814182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.814182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:08.814182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:08.947045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e4c73-9dcc-4a2f-b0f4-8926ae254e2e None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.947327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e4c73-9dcc-4a2f-b0f4-8926ae254e2e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.947638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e4c73-9dcc-4a2f-b0f4-8926ae254e2e None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.947923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1270/2508] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:08.952361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:08.952503 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1239/2509] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 21:01:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:08.957856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:08.958372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:08.958827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:08.990596 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] MFA Rules not processed for user `162eb7d6a9894e4ca60aa8da4537a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:08.991861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:09.021706 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3d5d-c06b-438b-afd0-6dabae1b9267 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.027314 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.027956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.028240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.028514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.029139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.031320 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.049264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1240/2510] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:09.061995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.063379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:09.073774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9dd5e-4bc6-47dc-aa2b-ea6e5131551c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.077373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d2c6e-bb8b-4538-8740-cda48e4a46b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.077966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d2c6e-bb8b-4538-8740-cda48e4a46b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.078247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d2c6e-bb8b-4538-8740-cda48e4a46b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.078522 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d2c6e-bb8b-4538-8740-cda48e4a46b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.086038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d2c6e-bb8b-4538-8740-cda48e4a46b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.087835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d2c6e-bb8b-4538-8740-cda48e4a46b0 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.095954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1241/2511] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:01:09.177988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dbc62-0df7-48f4-93c2-5c4f6eacd8cc None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.181246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dbc62-0df7-48f4-93c2-5c4f6eacd8cc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.181246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dbc62-0df7-48f4-93c2-5c4f6eacd8cc None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.181246 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1242/2512] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 21:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:01:09.184706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debdb2-f045-4b97-b81f-f6bcdd1ac7bf None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.185009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debdb2-f045-4b97-b81f-f6bcdd1ac7bf None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.185282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debdb2-f045-4b97-b81f-f6bcdd1ac7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.217823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-52debdb2-f045-4b97-b81f-f6bcdd1ac7bf None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:09.218918 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1271/2513] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:01:08 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:01:09.219051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-52debdb2-f045-4b97-b81f-f6bcdd1ac7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:09.223140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.233284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bd15-6c1f-49fe-885c-6b29c46110bc admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.239489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.240108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.240394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.240676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.241353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.242962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.247401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:09.253126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1272/2514] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:01:09.257239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.267614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708a008-8788-4659-b4fc-1ef56cff3bfb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.272566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.273815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.274101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.274376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.275019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.276676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.290911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1273/2515] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:09.292262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.301798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac65a0-9783-483d-8010-570d25721ad7 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.306478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.307101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1243/2516] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:01:09.307243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.307427 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.307708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] PATH_INFO: `/v3/projects/a6a538a7b5a042ab896fa256955936a1/users/b89ac15697ca4e1185e724a4d66ebb62/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.317568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52debdb2-f045-4b97-b81f-f6bcdd1ac7bf None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.327245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52debdb2-f045-4b97-b81f-f6bcdd1ac7bf None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.327432 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a538a7b5a042ab896fa256955936a1, user_id=b89ac15697ca4e1185e724a4d66ebb62, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.330185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.330913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845f69-6347-473b-9327-16c07303fd44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.331637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845f69-6347-473b-9327-16c07303fd44 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.331947 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845f69-6347-473b-9327-16c07303fd44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.332128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845f69-6347-473b-9327-16c07303fd44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.342552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce845f69-6347-473b-9327-16c07303fd44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.344065 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce845f69-6347-473b-9327-16c07303fd44 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.355776 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1244/2517] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:01:09.397069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1274/2518] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:01:09 2022] PUT /identity/v3/projects/a6a538a7b5a042ab896fa256955936a1/users/b89ac15697ca4e1185e724a4d66ebb62/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:09.408224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bbd2-3dbe-46bd-abc0-e71c76163f21 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.411278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bbd2-3dbe-46bd-abc0-e71c76163f21 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.411278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bbd2-3dbe-46bd-abc0-e71c76163f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.442892 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-0ee7bbd2-3dbe-46bd-abc0-e71c76163f21 None None] MFA Rules not processed for user `b89ac15697ca4e1185e724a4d66ebb62`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:09.444222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0ee7bbd2-3dbe-46bd-abc0-e71c76163f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:09.527028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1245/2519] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:09.534625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:09.536582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:09.603633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64aa14-da57-441a-9e2d-fbdc55b22bf3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:09.607276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1bcdf-c642-4467-ad23-2f8d7aeeb1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:09.607927 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1bcdf-c642-4467-ad23-2f8d7aeeb1ad service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:09.608211 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1bcdf-c642-4467-ad23-2f8d7aeeb1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:09.608488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1bcdf-c642-4467-ad23-2f8d7aeeb1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:09.617703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1bcdf-c642-4467-ad23-2f8d7aeeb1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:09.619175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1bcdf-c642-4467-ad23-2f8d7aeeb1ad service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:09.629010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1275/2520] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:01:19.518508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=62 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:19.624442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.165914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7bbd2-3dbe-46bd-abc0-e71c76163f21 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.264181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7bbd2-3dbe-46bd-abc0-e71c76163f21 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.281574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.282488 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.282959 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.283557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] PATH_INFO: `/v3/users/b89ac15697ca4e1185e724a4d66ebb62` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.285201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89ac15697ca4e1185e724a4d66ebb62)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.290303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.497083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89ac15697ca4e1185e724a4d66ebb62'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:21.497782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89ac15697ca4e1185e724a4d66ebb62'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:21.505971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89ac15697ca4e1185e724a4d66ebb62'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:21.508164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89ac15697ca4e1185e724a4d66ebb62'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:21.527940 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89ac15697ca4e1185e724a4d66ebb62'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:21.649464 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1246/2521] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:01:21 2022] DELETE /identity/v3/users/b89ac15697ca4e1185e724a4d66ebb62 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:21.656154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.657184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.657184 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.680412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:21.681912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:21.753683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1276/2522] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:21.760641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:21.762290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:21.840532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6831403-cc12-404a-8bc5-d19455b6fa42 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:21.844303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ebaa4-f284-45b1-b9c5-a467ea3df3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:21.844916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ebaa4-f284-45b1-b9c5-a467ea3df3bc service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:21.845201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ebaa4-f284-45b1-b9c5-a467ea3df3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:21.845474 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ebaa4-f284-45b1-b9c5-a467ea3df3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:21.856418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ebaa4-f284-45b1-b9c5-a467ea3df3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:21.858028 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ebaa4-f284-45b1-b9c5-a467ea3df3bc service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:21.869222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1247/2523] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:01:22.472589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.475989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:22.491060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558d8ec-429f-4291-97fa-471db41413b0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.496431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.497175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.497480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.497908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] PATH_INFO: `/v3/projects/a6a538a7b5a042ab896fa256955936a1` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.499855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a538a7b5a042ab896fa256955936a1)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.504602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.614254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a538a7b5a042ab896fa256955936a1', 'request_id': 'req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:22.619899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a538a7b5a042ab896fa256955936a1', 'request_id': 'req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:22.699116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a538a7b5a042ab896fa256955936a1', 'request_id': 'req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:22.714667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] The token cache is being invalidate because project a6a538a7b5a042ab896fa256955936a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:01:22.714967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:22.715877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-239f1b8e-7a0c-4c27-bc3a-28e9169f5a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:22.717423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1277/2524] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:01:22 2022] DELETE /identity/v3/projects/a6a538a7b5a042ab896fa256955936a1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:01:22.722347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85578-d22e-4076-a422-0c2a3a58ba7e None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.722716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85578-d22e-4076-a422-0c2a3a58ba7e None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.723220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85578-d22e-4076-a422-0c2a3a58ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.744230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c2b85578-d22e-4076-a422-0c2a3a58ba7e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:22.745673 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c2b85578-d22e-4076-a422-0c2a3a58ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:22.764359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.807682 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1248/2525] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:22.815678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9c54-0924-4170-8b8c-bf25f7b7e22b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.815962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9c54-0924-4170-8b8c-bf25f7b7e22b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.816235 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9c54-0924-4170-8b8c-bf25f7b7e22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.837199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ef4d9c54-0924-4170-8b8c-bf25f7b7e22b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:22.838411 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ef4d9c54-0924-4170-8b8c-bf25f7b7e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:22.846700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1278/2526] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:01:22.851148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85578-d22e-4076-a422-0c2a3a58ba7e None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.861139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85578-d22e-4076-a422-0c2a3a58ba7e None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.865866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.872505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.872505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.872505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.872505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:22.872505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.872505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:22.882969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1249/2527] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:22.887538 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d9c54-0924-4170-8b8c-bf25f7b7e22b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:22.896752 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d9c54-0924-4170-8b8c-bf25f7b7e22b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:22.902015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:22.902616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:22.902895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:22.903166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:22.903834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:22.905744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.048684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1279/2528] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:01:22 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:23.053096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:23.063813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42f821-2285-4501-a537-5c28b0bacb07 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.120844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.121461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.121868 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.122145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.123409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.124711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.242310 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1250/2529] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:01:23 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:01:23.248085 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:23.259529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4345c1-a1e3-4501-b8ba-9fc606ffd6fb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.264153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.264753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.265038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.265328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.265952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.267588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.277486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1280/2530] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:23.281810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:23.292174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938234c-012a-4efb-91bd-0ccbbce41de1 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.297121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a751457-645e-41a3-a25b-17230cccc96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.297854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751457-645e-41a3-a25b-17230cccc96f admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.298204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751457-645e-41a3-a25b-17230cccc96f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.298484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751457-645e-41a3-a25b-17230cccc96f admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.299135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a751457-645e-41a3-a25b-17230cccc96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.300824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a751457-645e-41a3-a25b-17230cccc96f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.312279 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1251/2531] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:01:23.316625 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:23.327390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7bdbc-0885-47ac-bf47-6e4361540e37 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.331950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.332655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.332934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.333200 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] PATH_INFO: `/v3/projects/fe57cde4b0c44fd89f4fa854e7b80262/users/1158306342fc43b9b0942b22f22b2444/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.348251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe57cde4b0c44fd89f4fa854e7b80262, user_id=1158306342fc43b9b0942b22f22b2444, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.351070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.447774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1281/2532] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:01:23 2022] PUT /identity/v3/projects/fe57cde4b0c44fd89f4fa854e7b80262/users/1158306342fc43b9b0942b22f22b2444/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:23.460195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644cdf-609a-4a5a-a17d-0081b7cdb99a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.460568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644cdf-609a-4a5a-a17d-0081b7cdb99a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.460871 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644cdf-609a-4a5a-a17d-0081b7cdb99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.491424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-87644cdf-609a-4a5a-a17d-0081b7cdb99a None None] MFA Rules not processed for user `1158306342fc43b9b0942b22f22b2444`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:23.493335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-87644cdf-609a-4a5a-a17d-0081b7cdb99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:23.570984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:23.571990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1252/2533] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:23.597993 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:23.654593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c225bc-34d6-46fe-bc9d-66ce3388d136 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.660127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.660853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.661213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.661557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.662274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.665173 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:23.818108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1282/2534] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:01:23 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:23.820970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644cdf-609a-4a5a-a17d-0081b7cdb99a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:23.830618 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644cdf-609a-4a5a-a17d-0081b7cdb99a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:23.843671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:23.892688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:23.893460 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:23.893840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:23.894217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:23.895066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:23.898428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:24.033821 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1253/2535] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:01:23 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:24.035031 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:24.046431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee39ba-cfed-4356-b2b7-3246bf094a74 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:24.053215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:24.053862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:24.054164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:24.054442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:24.055110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:24.056776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:24.074252 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1283/2536] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:24.078521 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:24.090265 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2daf4-785f-4282-808d-af0340245b07 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:24.094903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:24.095601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:24.095883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:24.096187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] PATH_INFO: `/v3/projects/c2c5623ca4f34326af52651ea44f6be0/users/ea8d9f44ac784e90a5fdf887b26930da/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:24.111750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c5623ca4f34326af52651ea44f6be0, user_id=ea8d9f44ac784e90a5fdf887b26930da, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:24.114516 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:24.224880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1254/2537] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:01:24 2022] PUT /identity/v3/projects/c2c5623ca4f34326af52651ea44f6be0/users/ea8d9f44ac784e90a5fdf887b26930da/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:24.228951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:24.239000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f9f08-d36d-4979-889e-b14505d959ce admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:24.298923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc2a8e-a75f-429d-a58e-5d2891423d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:24.299571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2a8e-a75f-429d-a58e-5d2891423d2b admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:24.299855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2a8e-a75f-429d-a58e-5d2891423d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:24.303554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2a8e-a75f-429d-a58e-5d2891423d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:24.303554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc2a8e-a75f-429d-a58e-5d2891423d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:24.303554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc2a8e-a75f-429d-a58e-5d2891423d2b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:24.312547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1284/2538] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:24.316852 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:24.328052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36abe6c-3a87-4cb9-8eb5-485ad9d1630f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:24.332828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:24.333479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:24.333754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:24.334023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] PATH_INFO: `/v3/projects/c2c5623ca4f34326af52651ea44f6be0/users/ea8d9f44ac784e90a5fdf887b26930da/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:24.336541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c5623ca4f34326af52651ea44f6be0, user_id=ea8d9f44ac784e90a5fdf887b26930da, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:24.339187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:24.351097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1255/2539] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:01:24 2022] PUT /identity/v3/projects/c2c5623ca4f34326af52651ea44f6be0/users/ea8d9f44ac784e90a5fdf887b26930da/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:01:24.361732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb501d2-a129-41cd-b365-287ca275c80c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:24.362048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb501d2-a129-41cd-b365-287ca275c80c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:24.362286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb501d2-a129-41cd-b365-287ca275c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:24.394305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-5eb501d2-a129-41cd-b365-287ca275c80c None None] MFA Rules not processed for user `ea8d9f44ac784e90a5fdf887b26930da`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:24.395844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5eb501d2-a129-41cd-b365-287ca275c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:24.478926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1285/2540] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:24.490499 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:24.492909 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:24.577103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de944-0cc4-451b-8e83-93e1f4cea608 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:24.581923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:24.583523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:24.583523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:24.583523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:24.593181 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:24.594655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:24.604987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1256/2541] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:01:24.900417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb501d2-a129-41cd-b365-287ca275c80c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:24.911225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb501d2-a129-41cd-b365-287ca275c80c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:24.915911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fd9ab-81ba-492a-b842-568a1bda11b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:24.916556 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd9ab-81ba-492a-b842-568a1bda11b5 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:24.916841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd9ab-81ba-492a-b842-568a1bda11b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:24.917118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd9ab-81ba-492a-b842-568a1bda11b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:24.932362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:24.984446 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd9ab-81ba-492a-b842-568a1bda11b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:24.991774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd9ab-81ba-492a-b842-568a1bda11b5 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:25.003633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1286/2542] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:01:25.572913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:25.575052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:25.670313 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd96d28-be64-483e-b54d-9b944ca62c3b service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:25.675506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:25.676205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:25.676405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:25.676678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:25.678471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:25.690742 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:25.692429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:25.704987 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1257/2543] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:01:27.202060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:27.203343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:27.203343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:27.222435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:27.223960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:27.288531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1287/2544] 10.222.0.62 () {58 vars in 967 bytes} [Thu Aug 18 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:27.490943 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:27.492351 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:27.497239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:27.573145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92672a-15c1-434f-8ac4-7b399f22ca7c service placement] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:27.578592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:27.579254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:27.579611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:27.579931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:27.589392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:27.591149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:27.601399 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1258/2545] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 21:01:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:01:32.831635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:32.833829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:32.854283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bff100-73d9-41cc-be12-9021e3e88732 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:32.864780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:32.865767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:32.866120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:32.866394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:32.868258 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:32.880457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:32.882088 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:32.893124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1288/2546] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:01:36.928969 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:36.932591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:37.008472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec61c-3160-49f9-83e1-fd23f12996ed service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.014283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.015264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.015678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.016081 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] PATH_INFO: `/v3/users/d87dd0b10a4a4db39935df509bc8eb0b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.017376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87dd0b10a4a4db39935df509bc8eb0b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.019840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.236967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87dd0b10a4a4db39935df509bc8eb0b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.237708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87dd0b10a4a4db39935df509bc8eb0b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.246672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87dd0b10a4a4db39935df509bc8eb0b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.247342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87dd0b10a4a4db39935df509bc8eb0b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.259773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87dd0b10a4a4db39935df509bc8eb0b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.390270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1259/2547] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:01:36 2022] DELETE /identity/v3/users/d87dd0b10a4a4db39935df509bc8eb0b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:37.719201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.730189 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2120a-3bf7-4b2e-ae3e-f1e4f546106c service placement] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:37.790699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:37.791327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:37.791639 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:37.791916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] PATH_INFO: `/v3/projects/3ed3d374c7a145918d9ad3b770cb562b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:37.793033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed3d374c7a145918d9ad3b770cb562b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:37.795133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:37.899614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:37.900835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed3d374c7a145918d9ad3b770cb562b', 'request_id': 'req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.906657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed3d374c7a145918d9ad3b770cb562b', 'request_id': 'req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.978329 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed3d374c7a145918d9ad3b770cb562b', 'request_id': 'req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.989774 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] The token cache is being invalidate because project 3ed3d374c7a145918d9ad3b770cb562b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:01:37.990582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.990685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:37.992217 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1289/2548] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:01:37 2022] DELETE /identity/v3/projects/3ed3d374c7a145918d9ad3b770cb562b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:37.996502 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:37.997944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:38.011773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a84e3-7d64-4ece-87f8-134def0b5463 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.020033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:38.069619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.070866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.071152 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.071456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] PATH_INFO: `/v3/users/b824788c02e446b6b826443c36539740` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.072599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b824788c02e446b6b826443c36539740)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.074501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:38.324796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b824788c02e446b6b826443c36539740'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:38.325451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b824788c02e446b6b826443c36539740'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:38.332571 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b824788c02e446b6b826443c36539740'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:38.333214 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b824788c02e446b6b826443c36539740'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:38.354097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b824788c02e446b6b826443c36539740'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:38.486752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1260/2549] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:01:37 2022] DELETE /identity/v3/users/b824788c02e446b6b826443c36539740 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:38.792299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:38.793785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:38.807191 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f40d-befc-4bcf-a198-d4937b3a5d7f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:38.875154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:38.875822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:38.876103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:38.876378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] PATH_INFO: `/v3/projects/2f85fc72536b48e5967f99ffc72c1e09` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:38.877512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f85fc72536b48e5967f99ffc72c1e09)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:38.879452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:39.046433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f85fc72536b48e5967f99ffc72c1e09', 'request_id': 'req-3a63cca1-265a-4425-99fd-5c5863273ae6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:39.052247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f85fc72536b48e5967f99ffc72c1e09', 'request_id': 'req-3a63cca1-265a-4425-99fd-5c5863273ae6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:39.196005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f85fc72536b48e5967f99ffc72c1e09', 'request_id': 'req-3a63cca1-265a-4425-99fd-5c5863273ae6'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:39.207906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] The token cache is being invalidate because project 2f85fc72536b48e5967f99ffc72c1e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:01:39.208204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:39.208852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-3a63cca1-265a-4425-99fd-5c5863273ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:39.210450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1290/2550] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:01:38 2022] DELETE /identity/v3/projects/2f85fc72536b48e5967f99ffc72c1e09 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:48.483062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:49.204695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:25.136485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:25.138303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:25.151916 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e73f0-7192-41bd-9a7a-b5e19edcb1fb admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:25.212333 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:25.212981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:25.213270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:25.213552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] PATH_INFO: `/v3/users/1158306342fc43b9b0942b22f22b2444` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:25.214703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1158306342fc43b9b0942b22f22b2444)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:25.216952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:25.425824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1158306342fc43b9b0942b22f22b2444'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:25.426418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1158306342fc43b9b0942b22f22b2444'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:25.433825 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1158306342fc43b9b0942b22f22b2444'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:25.434481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1158306342fc43b9b0942b22f22b2444'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:25.447696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1158306342fc43b9b0942b22f22b2444'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:25.532245 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1261/2551] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:02:25 2022] DELETE /identity/v3/users/1158306342fc43b9b0942b22f22b2444 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:25.537161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:25.537744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:25.537744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:25.562976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:25.564246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:25.636727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1291/2552] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:25.646526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:25.648145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:25.732504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e631f-efa7-4afe-9246-2b55414f7c5c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:25.736185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:25.736828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:25.737114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:25.737392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:25.746902 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:25.748424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:25.758694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1262/2553] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:26.225593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:26.227759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:26.246195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92bc15-cc88-4c14-a1fc-dfbfbdcf83c8 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:26.251448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:26.252182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:26.252539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:26.252891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] PATH_INFO: `/v3/projects/fe57cde4b0c44fd89f4fa854e7b80262` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:26.254175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe57cde4b0c44fd89f4fa854e7b80262)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:26.256330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:26.381614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe57cde4b0c44fd89f4fa854e7b80262', 'request_id': 'req-2c93d316-8b28-4b96-a9f6-c890bd084746'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.388303 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe57cde4b0c44fd89f4fa854e7b80262', 'request_id': 'req-2c93d316-8b28-4b96-a9f6-c890bd084746'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.458280 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe57cde4b0c44fd89f4fa854e7b80262', 'request_id': 'req-2c93d316-8b28-4b96-a9f6-c890bd084746'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.471721 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] The token cache is being invalidate because project fe57cde4b0c44fd89f4fa854e7b80262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:02:26.472026 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.472689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.474630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1292/2554] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:02:26 2022] DELETE /identity/v3/projects/fe57cde4b0c44fd89f4fa854e7b80262 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:26.478590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:26.483864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:26.489424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409b9bf-37c4-42f1-ad15-d7805438445b service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:26.550738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:26.551665 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:26.552093 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:26.552514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] PATH_INFO: `/v3/users/ea8d9f44ac784e90a5fdf887b26930da` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:26.554010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8d9f44ac784e90a5fdf887b26930da)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:26.556161 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:26.787296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8d9f44ac784e90a5fdf887b26930da'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.787828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8d9f44ac784e90a5fdf887b26930da'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.796099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8d9f44ac784e90a5fdf887b26930da'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.796705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8d9f44ac784e90a5fdf887b26930da'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.808466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-19e02497-1468-48e9-92e2-32ce29953540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8d9f44ac784e90a5fdf887b26930da'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:26.910020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1263/2555] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:02:26 2022] DELETE /identity/v3/users/ea8d9f44ac784e90a5fdf887b26930da => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:27.482817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:27.484328 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:27.500360 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d316-8b28-4b96-a9f6-c890bd084746 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:27.564139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:27.565210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:27.565496 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:27.565776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] PATH_INFO: `/v3/projects/c2c5623ca4f34326af52651ea44f6be0` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:27.566998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c5623ca4f34326af52651ea44f6be0)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:27.568987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:27.694716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa96db0-4dd9-4c0d-8d2f-cd1834b01c6d None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:27.695302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa96db0-4dd9-4c0d-8d2f-cd1834b01c6d None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:27.695302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa96db0-4dd9-4c0d-8d2f-cd1834b01c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:27.711139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:27.715002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-4fa96db0-4dd9-4c0d-8d2f-cd1834b01c6d None None] MFA Rules not processed for user `b5b5dd3c92034837921826c9b2dea76b`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:27.716250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4fa96db0-4dd9-4c0d-8d2f-cd1834b01c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:27.727874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c5623ca4f34326af52651ea44f6be0', 'request_id': 'req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:27.733378 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c5623ca4f34326af52651ea44f6be0', 'request_id': 'req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:27.773236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1264/2556] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:02:27.840949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c5623ca4f34326af52651ea44f6be0', 'request_id': 'req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:27.853641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] The token cache is being invalidate because project c2c5623ca4f34326af52651ea44f6be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:02:27.853936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:27.854592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f03a8e48-d645-4fd0-a77d-2de8b6ce4cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:27.856196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1293/2557] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:02:27 2022] DELETE /identity/v3/projects/c2c5623ca4f34326af52651ea44f6be0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:27.861304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea6089-ea3c-4e24-9a9f-fb4e1f087a64 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:27.861881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea6089-ea3c-4e24-9a9f-fb4e1f087a64 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:27.862241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea6089-ea3c-4e24-9a9f-fb4e1f087a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:27.882183 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d7ea6089-ea3c-4e24-9a9f-fb4e1f087a64 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:27.883401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d7ea6089-ea3c-4e24-9a9f-fb4e1f087a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:27.911394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:27.949944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1265/2558] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:27.957960 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac891-1b62-4272-9fa6-b9c810d22b2d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:27.958325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac891-1b62-4272-9fa6-b9c810d22b2d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:27.958676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac891-1b62-4272-9fa6-b9c810d22b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:27.985807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-898ac891-1b62-4272-9fa6-b9c810d22b2d None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:27.985807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-898ac891-1b62-4272-9fa6-b9c810d22b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:27.990444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1294/2559] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:27.995620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea6089-ea3c-4e24-9a9f-fb4e1f087a64 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.008716 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea6089-ea3c-4e24-9a9f-fb4e1f087a64 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.010952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.011593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.011880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.012211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.013012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:28.013322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.014928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:28.030439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1266/2560] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:28.031824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ac891-1b62-4272-9fa6-b9c810d22b2d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.042095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ac891-1b62-4272-9fa6-b9c810d22b2d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.047149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.047816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.048101 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.048374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.049024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.050936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:28.140159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1295/2561] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:02:28 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:28.144361 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.154668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59d942-af7c-4eb2-a428-62e25787c2dc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.216493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.217098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.217371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.217638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.218269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.220220 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:28.332906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1267/2562] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:28 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:02:28.338082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.349511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7661-a9bc-4b85-8947-511e79fd1947 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.354991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.355632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.355917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.356194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.356902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.358506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:28.369250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1296/2563] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:28.373504 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.383944 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722f16-35c9-4429-8a0d-dbc8f7142dc0 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.388784 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61150fe7-d175-4937-ad9a-11e607489801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.389380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61150fe7-d175-4937-ad9a-11e607489801 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.389664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61150fe7-d175-4937-ad9a-11e607489801 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.389954 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61150fe7-d175-4937-ad9a-11e607489801 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.390591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61150fe7-d175-4937-ad9a-11e607489801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.392225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61150fe7-d175-4937-ad9a-11e607489801 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:28.403445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1268/2564] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:28.407814 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.418336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c721442-6799-4895-9d4c-963d23fecf75 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.422886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.423572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.423863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.424140 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] PATH_INFO: `/v3/projects/e2d9646902c4482a8897f0ae0f965e03/users/e298e6efb3f44d6c9f48f8fb7f3b3981/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.438958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d9646902c4482a8897f0ae0f965e03, user_id=e298e6efb3f44d6c9f48f8fb7f3b3981, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.441659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:28.558979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1297/2565] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:02:28 2022] PUT /identity/v3/projects/e2d9646902c4482a8897f0ae0f965e03/users/e298e6efb3f44d6c9f48f8fb7f3b3981/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:28.561796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c95cef-eaa5-43ee-9dec-ec355d7a9303 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.562085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c95cef-eaa5-43ee-9dec-ec355d7a9303 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.563036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c95cef-eaa5-43ee-9dec-ec355d7a9303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.594539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-24c95cef-eaa5-43ee-9dec-ec355d7a9303 None None] MFA Rules not processed for user `e298e6efb3f44d6c9f48f8fb7f3b3981`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:28.595815 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-24c95cef-eaa5-43ee-9dec-ec355d7a9303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:28.664159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1269/2566] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:28.668887 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.729453 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d53192-fe7c-4938-93b5-71e0b85cf504 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.734223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.734818 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.735095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.735382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.736005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.737999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:28.848498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1298/2567] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:02:28 2022] POST /identity/v3/projects => generated 401 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:28.852696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c95cef-eaa5-43ee-9dec-ec355d7a9303 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:28.866184 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c95cef-eaa5-43ee-9dec-ec355d7a9303 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:28.886171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:28.925816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:28.926453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:28.926733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:28.927007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:28.927692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:28.929839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:29.092404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1270/2568] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:28 2022] POST /identity/v3/users => generated 307 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:29.096450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:29.106841 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b203d-a99b-42da-a5c4-17298f0c41c7 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:29.111824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:29.112020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:29.112299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:29.112572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:29.113245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:29.114901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:29.126393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1299/2569] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:29.130631 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:29.141690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31a247-9a72-41e4-a35b-788637a4096e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:29.146280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:29.146930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:29.147215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:29.147533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] PATH_INFO: `/v3/projects/c67034438dd94ba98f51a1aef4d5f642/users/6b4c5b52f75844e5a6723d570de0eaad/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:29.163070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67034438dd94ba98f51a1aef4d5f642, user_id=6b4c5b52f75844e5a6723d570de0eaad, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:29.165869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:29.265632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1271/2570] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:02:29 2022] PUT /identity/v3/projects/c67034438dd94ba98f51a1aef4d5f642/users/6b4c5b52f75844e5a6723d570de0eaad/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:29.269618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:29.279846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206c4f2-9450-4d6e-b85c-16287055b920 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:29.300115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:29.336667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8617a-3a5a-449f-b44d-58b960c8492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:29.337284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8617a-3a5a-449f-b44d-58b960c8492a admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:29.337558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8617a-3a5a-449f-b44d-58b960c8492a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:29.337833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8617a-3a5a-449f-b44d-58b960c8492a admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:29.338504 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8617a-3a5a-449f-b44d-58b960c8492a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:29.340147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8617a-3a5a-449f-b44d-58b960c8492a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:29.357390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1300/2571] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:29.361396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:29.372545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2142094-1e59-4d48-bdd2-a8ac70f9e2c1 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:29.377324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:29.377975 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:29.378258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:29.378537 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] PATH_INFO: `/v3/projects/c67034438dd94ba98f51a1aef4d5f642/users/6b4c5b52f75844e5a6723d570de0eaad/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:29.380505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67034438dd94ba98f51a1aef4d5f642, user_id=6b4c5b52f75844e5a6723d570de0eaad, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:29.383158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:29.393374 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1272/2572] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:02:29 2022] PUT /identity/v3/projects/c67034438dd94ba98f51a1aef4d5f642/users/6b4c5b52f75844e5a6723d570de0eaad/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:02:29.404668 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de911-3079-4462-9036-89254085c115 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:29.404961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de911-3079-4462-9036-89254085c115 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:29.405238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de911-3079-4462-9036-89254085c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:29.434138 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-029de911-3079-4462-9036-89254085c115 None None] MFA Rules not processed for user `6b4c5b52f75844e5a6723d570de0eaad`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:29.435353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-029de911-3079-4462-9036-89254085c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:29.504232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1301/2573] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:29.515079 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:29.520962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:29.625342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1b1d9-adc7-4a58-b49c-d163b297defc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:29.629309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:29.629921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:29.630205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:29.630482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:29.644016 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:29.653547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:29.657734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1273/2574] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:29 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:29.916632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de911-3079-4462-9036-89254085c115 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:29.926847 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de911-3079-4462-9036-89254085c115 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:29.930486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2e309-d652-4bb8-a810-a9494b469f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:29.931166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2e309-d652-4bb8-a810-a9494b469f12 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:29.932029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2e309-d652-4bb8-a810-a9494b469f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:29.932313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2e309-d652-4bb8-a810-a9494b469f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:29.990871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2e309-d652-4bb8-a810-a9494b469f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:29.992353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2e309-d652-4bb8-a810-a9494b469f12 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:30.001953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1302/2575] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:36.489946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:36.549953 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:36.554048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bbad6-55ce-40d6-94d7-5dfef1e2b132 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:36.559567 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:36.561256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:36.561256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:36.561256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] PATH_INFO: `/v3/users/e298e6efb3f44d6c9f48f8fb7f3b3981` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:36.562914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e298e6efb3f44d6c9f48f8fb7f3b3981)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:36.564893 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:36.832386 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e298e6efb3f44d6c9f48f8fb7f3b3981'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:36.833045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e298e6efb3f44d6c9f48f8fb7f3b3981'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:36.840756 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e298e6efb3f44d6c9f48f8fb7f3b3981'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:36.841430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e298e6efb3f44d6c9f48f8fb7f3b3981'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:36.853552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e298e6efb3f44d6c9f48f8fb7f3b3981'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:36.932811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1274/2576] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:02:36 2022] DELETE /identity/v3/users/e298e6efb3f44d6c9f48f8fb7f3b3981 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:36.937699 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:36.938686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:36.938686 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:36.957831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:36.959123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:37.000685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:37.019791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1303/2577] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:37.030107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:37.031570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:37.089350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b64f62-1940-4e5c-8a28-b1b199569b90 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:37.093025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:37.093638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:37.093922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:37.094198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:37.103686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:37.105179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:37.115688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1275/2578] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:37.548982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:37.550877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:37.563954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f4ac-b483-4e7c-8426-94cbda8864d7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:37.568899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:37.569921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:37.569921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:37.570146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] PATH_INFO: `/v3/projects/e2d9646902c4482a8897f0ae0f965e03` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:37.571431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d9646902c4482a8897f0ae0f965e03)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:37.574120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:37.712233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d9646902c4482a8897f0ae0f965e03', 'request_id': 'req-b3986ccf-847e-47a7-86f7-0be954b85c84'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:37.718023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d9646902c4482a8897f0ae0f965e03', 'request_id': 'req-b3986ccf-847e-47a7-86f7-0be954b85c84'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:37.795533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d9646902c4482a8897f0ae0f965e03', 'request_id': 'req-b3986ccf-847e-47a7-86f7-0be954b85c84'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:37.809984 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] The token cache is being invalidate because project e2d9646902c4482a8897f0ae0f965e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:02:37.815150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:37.815150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:37.815150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1304/2579] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:02:37 2022] DELETE /identity/v3/projects/e2d9646902c4482a8897f0ae0f965e03 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:37.816610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:37.826991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22acf8-2752-4316-a661-5469da31d9e6 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:37.897934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:37.898570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:37.898854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:37.899128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] PATH_INFO: `/v3/users/6b4c5b52f75844e5a6723d570de0eaad` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:37.900397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4c5b52f75844e5a6723d570de0eaad)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:37.902408 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:37.925268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:38.152454 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4c5b52f75844e5a6723d570de0eaad'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:38.153163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4c5b52f75844e5a6723d570de0eaad'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:38.161240 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4c5b52f75844e5a6723d570de0eaad'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:38.161990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4c5b52f75844e5a6723d570de0eaad'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:38.174779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-2463fdd1-6bb3-4475-9711-9c9067eb3167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4c5b52f75844e5a6723d570de0eaad'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:38.258403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1276/2580] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:02:37 2022] DELETE /identity/v3/users/6b4c5b52f75844e5a6723d570de0eaad => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:38.700398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:38.701996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:38.717676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986ccf-847e-47a7-86f7-0be954b85c84 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:38.778132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:38.778683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:38.778973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:38.779244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] PATH_INFO: `/v3/projects/c67034438dd94ba98f51a1aef4d5f642` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:38.780444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67034438dd94ba98f51a1aef4d5f642)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:38.782354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:38.909749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67034438dd94ba98f51a1aef4d5f642', 'request_id': 'req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:38.915524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67034438dd94ba98f51a1aef4d5f642', 'request_id': 'req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:39.063608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67034438dd94ba98f51a1aef4d5f642', 'request_id': 'req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:39.072067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:39.079170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] The token cache is being invalidate because project c67034438dd94ba98f51a1aef4d5f642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:02:39.079499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:39.080193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-a72aad0f-c663-4c69-a198-3ad0f1f2d75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:39.081708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1305/2581] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:02:38 2022] DELETE /identity/v3/projects/c67034438dd94ba98f51a1aef4d5f642 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:39.086646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e6329-dbeb-425c-9270-f59bc014d0af None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.087124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e6329-dbeb-425c-9270-f59bc014d0af None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.087262 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e6329-dbeb-425c-9270-f59bc014d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.107754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-bc8e6329-dbeb-425c-9270-f59bc014d0af None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:39.108958 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bc8e6329-dbeb-425c-9270-f59bc014d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:39.168270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1277/2582] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:39.177857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b9d8-8506-421f-81b1-4323a788b4d0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.177857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b9d8-8506-421f-81b1-4323a788b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.177857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b9d8-8506-421f-81b1-4323a788b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.196288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a408b9d8-8506-421f-81b1-4323a788b4d0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:39.198024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a408b9d8-8506-421f-81b1-4323a788b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:39.205991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1306/2583] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:39.210233 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e6329-dbeb-425c-9270-f59bc014d0af None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:39.220568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e6329-dbeb-425c-9270-f59bc014d0af None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:39.225269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:39.225862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.226144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.226417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.227064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:39.227390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:39.229023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:39.240659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1278/2584] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:39.245188 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408b9d8-8506-421f-81b1-4323a788b4d0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:39.254665 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408b9d8-8506-421f-81b1-4323a788b4d0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:39.259540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:39.260712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.260959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.261233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.261863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:39.263894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:39.368277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1307/2585] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:02:39 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:39.372433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:39.382525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba037-29d5-42d2-8c5e-7f0e7a3fb7d0 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:39.440435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:39.441038 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.441315 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.441582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.442199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:39.444149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:39.550283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1279/2586] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:39 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:02:39.554245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:39.565334 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2833-c5a3-4336-8b03-7c4848bb7ab8 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:39.571201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:39.571852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.572142 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.572408 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.573633 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:39.575292 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:39.585460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1308/2587] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:39.589491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:39.600029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3723b35-8326-4d42-a600-d9ba0107c315 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:39.605063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4bdb6-757d-4863-876f-c3b5129aee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:39.605598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4bdb6-757d-4863-876f-c3b5129aee28 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.605881 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4bdb6-757d-4863-876f-c3b5129aee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.606157 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4bdb6-757d-4863-876f-c3b5129aee28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.606807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4bdb6-757d-4863-876f-c3b5129aee28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:39.608562 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4bdb6-757d-4863-876f-c3b5129aee28 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:39.620296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1280/2588] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:39.625115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:39.635768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0eb0f-03c7-4a3f-a0bf-96d39e479fe4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:39.640483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:39.641132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.641417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.641697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] PATH_INFO: `/v3/projects/1abf017718d544848316be24d487016b/users/01ef5c6d7f9e4d13acea45cee1a39bd8/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.657014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abf017718d544848316be24d487016b, user_id=01ef5c6d7f9e4d13acea45cee1a39bd8, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:39.660038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:39.761336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1309/2589] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:02:39 2022] PUT /identity/v3/projects/1abf017718d544848316be24d487016b/users/01ef5c6d7f9e4d13acea45cee1a39bd8/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:39.773448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad71fe-4125-4c3a-926f-a4d1aefcd0c4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.773743 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad71fe-4125-4c3a-926f-a4d1aefcd0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.774019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad71fe-4125-4c3a-926f-a4d1aefcd0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.783379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:39.803678 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6aad71fe-4125-4c3a-926f-a4d1aefcd0c4 None None] MFA Rules not processed for user `01ef5c6d7f9e4d13acea45cee1a39bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:39.804933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6aad71fe-4125-4c3a-926f-a4d1aefcd0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:39.871123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1281/2590] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:39.882326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:39.884070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:39.944414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf69db-0288-4082-8007-bc5ca4c56a2c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:39.948302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51384bcb-9326-4c61-89bb-d895fe0c3c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:39.949110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51384bcb-9326-4c61-89bb-d895fe0c3c4f service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:39.949461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51384bcb-9326-4c61-89bb-d895fe0c3c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:39.949829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51384bcb-9326-4c61-89bb-d895fe0c3c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:39.958856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51384bcb-9326-4c61-89bb-d895fe0c3c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:39.960513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51384bcb-9326-4c61-89bb-d895fe0c3c4f service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:39.970822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1310/2591] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:39.994007 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad71fe-4125-4c3a-926f-a4d1aefcd0c4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:40.061405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad71fe-4125-4c3a-926f-a4d1aefcd0c4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:40.066102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:40.066735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:40.067012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:40.067286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] PATH_INFO: `/v3/users/01ef5c6d7f9e4d13acea45cee1a39bd8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:40.068525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ef5c6d7f9e4d13acea45cee1a39bd8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:40.070476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:40.313928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ef5c6d7f9e4d13acea45cee1a39bd8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:40.314583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ef5c6d7f9e4d13acea45cee1a39bd8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:40.321994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ef5c6d7f9e4d13acea45cee1a39bd8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:40.322684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ef5c6d7f9e4d13acea45cee1a39bd8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:40.334745 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ef5c6d7f9e4d13acea45cee1a39bd8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:40.406934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1282/2592] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:02:39 2022] DELETE /identity/v3/users/01ef5c6d7f9e4d13acea45cee1a39bd8 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:40.411905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:40.412266 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:40.412583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:40.432390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:40.433840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:40.498163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1311/2593] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:40.507995 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:40.509409 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:40.567015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf3360-1274-43bf-9f39-b949cb8deee9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:40.570590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988171f-eb4f-468c-8337-79f816f5a5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:40.571204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988171f-eb4f-468c-8337-79f816f5a5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:40.571523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988171f-eb4f-468c-8337-79f816f5a5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:40.571798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988171f-eb4f-468c-8337-79f816f5a5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:40.581658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988171f-eb4f-468c-8337-79f816f5a5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:40.584209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988171f-eb4f-468c-8337-79f816f5a5a7 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:40.594335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1283/2594] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:40.732644 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:41.019947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:41.024156 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:41.034463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8c8a4-b965-4761-a396-4131c1c0c768 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:41.039281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:41.039951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.040234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.040510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] PATH_INFO: `/v3/projects/1abf017718d544848316be24d487016b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.042346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abf017718d544848316be24d487016b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:41.044356 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:41.178348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:41.190748 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abf017718d544848316be24d487016b', 'request_id': 'req-6fd3897e-707c-4be5-abb9-7639ca918516'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:41.196323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abf017718d544848316be24d487016b', 'request_id': 'req-6fd3897e-707c-4be5-abb9-7639ca918516'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:41.263849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abf017718d544848316be24d487016b', 'request_id': 'req-6fd3897e-707c-4be5-abb9-7639ca918516'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:41.279654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] The token cache is being invalidate because project 1abf017718d544848316be24d487016b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:02:41.279654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:41.279654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-6fd3897e-707c-4be5-abb9-7639ca918516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:02:41.282003 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1312/2595] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:02:41 2022] DELETE /identity/v3/projects/1abf017718d544848316be24d487016b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:41.286751 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bb2e-4a5a-4fc0-a5e0-b9b8f9b078e8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.287037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bb2e-4a5a-4fc0-a5e0-b9b8f9b078e8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.287309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bb2e-4a5a-4fc0-a5e0-b9b8f9b078e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.308681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-41a2bb2e-4a5a-4fc0-a5e0-b9b8f9b078e8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:41.310896 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-41a2bb2e-4a5a-4fc0-a5e0-b9b8f9b078e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:41.372703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1284/2596] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:41.380196 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66d37-f6df-4bf7-add8-1276a70292d5 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.380478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66d37-f6df-4bf7-add8-1276a70292d5 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.380755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66d37-f6df-4bf7-add8-1276a70292d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.402769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d9d66d37-f6df-4bf7-add8-1276a70292d5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:41.404069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d9d66d37-f6df-4bf7-add8-1276a70292d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:41.412758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1313/2597] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:41.417243 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2bb2e-4a5a-4fc0-a5e0-b9b8f9b078e8 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:41.427285 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2bb2e-4a5a-4fc0-a5e0-b9b8f9b078e8 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:41.432379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:41.432991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.433271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.433544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.434400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:02:41.434512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:41.436156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:41.448801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1285/2598] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:02:41.453013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66d37-f6df-4bf7-add8-1276a70292d5 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:41.462836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66d37-f6df-4bf7-add8-1276a70292d5 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:41.468323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:41.468925 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.469204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.469590 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.470367 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:41.472331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:41.568912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1314/2599] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:02:41 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:41.573741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:41.584049 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f86e1d-7d54-453a-b927-098a06688bea admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:41.646717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:41.647325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.647660 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.647935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.648593 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:41.650560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:41.761646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1286/2600] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:02:41 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:02:41.765785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:41.776511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d2366-1abe-4d24-a270-dea7db30ac39 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:41.785869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:41.786487 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.786782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.787047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.787772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:41.789608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:41.801645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1315/2601] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:02:41.805900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:41.817222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23064a-69b8-477f-bbab-43890a75cb99 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:41.823280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c365-fd58-4d62-aaed-208262bafbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:41.823280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c365-fd58-4d62-aaed-208262bafbec admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.823609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c365-fd58-4d62-aaed-208262bafbec admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.823879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c365-fd58-4d62-aaed-208262bafbec admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.824525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88c365-fd58-4d62-aaed-208262bafbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:41.826147 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88c365-fd58-4d62-aaed-208262bafbec admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:41.839326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1287/2602] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:02:41.843749 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:41.854083 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df369955-3c22-445c-bc34-5377255c3819 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:41.858707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:41.859398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.859683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.859954 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] PATH_INFO: `/v3/projects/32366eaaa6d342adb39c9175a121324a/users/d1b36de9654d42a685c96ec7ea6608f3/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.874840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32366eaaa6d342adb39c9175a121324a, user_id=d1b36de9654d42a685c96ec7ea6608f3, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:41.877505 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:41.955886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1316/2603] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:02:41 2022] PUT /identity/v3/projects/32366eaaa6d342adb39c9175a121324a/users/d1b36de9654d42a685c96ec7ea6608f3/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:41.961003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bdaa-d715-432c-9317-91baead89fa8 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:41.961294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bdaa-d715-432c-9317-91baead89fa8 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:41.961572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bdaa-d715-432c-9317-91baead89fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:41.980146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-edd4bdaa-d715-432c-9317-91baead89fa8 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:41.981348 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-edd4bdaa-d715-432c-9317-91baead89fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:41.998824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:42.040610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1288/2604] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:42.050641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:42.052530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:42.115134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8cc6-e7a9-4b2a-9a2d-0972bbf37fe3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:42.118966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:42.119746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:42.121932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:42.121932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:42.130445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:42.132172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:42.144762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1317/2605] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:43.785444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfde7-345a-4ff8-8fa7-f94ec4f5ec9b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:43.786051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfde7-345a-4ff8-8fa7-f94ec4f5ec9b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:43.786260 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfde7-345a-4ff8-8fa7-f94ec4f5ec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:43.828389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a56cfde7-345a-4ff8-8fa7-f94ec4f5ec9b None None] MFA Rules not processed for user `d1b36de9654d42a685c96ec7ea6608f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:43.829686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a56cfde7-345a-4ff8-8fa7-f94ec4f5ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:43.918505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1289/2606] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:43.930514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:02:43.932742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:44.001395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28af29-2831-438d-b706-e5982795abea service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:02:44.006285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:02:44.007129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:44.007422 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:44.007632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:44.016837 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:02:44.018287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:02:44.031248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1318/2607] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:02:47.238017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f0e6-31d5-49ad-9b5c-3ff7758f71fc None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:02:47.238580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f0e6-31d5-49ad-9b5c-3ff7758f71fc None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:02:47.238580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f0e6-31d5-49ad-9b5c-3ff7758f71fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:02:47.264913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-a2e4f0e6-31d5-49ad-9b5c-3ff7758f71fc None None] MFA Rules not processed for user `d1b36de9654d42a685c96ec7ea6608f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:02:47.266752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-a2e4f0e6-31d5-49ad-9b5c-3ff7758f71fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:02:47.274290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1290/2608] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:02:54.023528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:57.257442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=52 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:07.077010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:07.078915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:07.091982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6738-de7c-42e1-84b7-d8fbe52b1761 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:07.095936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:07.096570 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:07.096849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:07.097121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:07.099589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:07.175693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:07.177696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:07.189753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1319/2609] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:08.291622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df08f5f-cc6f-4005-9ddd-bd16541495b7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:08.293080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df08f5f-cc6f-4005-9ddd-bd16541495b7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:08.293080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df08f5f-cc6f-4005-9ddd-bd16541495b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:08.312706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1df08f5f-cc6f-4005-9ddd-bd16541495b7 None None] MFA Rules not processed for user `d1b36de9654d42a685c96ec7ea6608f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:08.313989 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1df08f5f-cc6f-4005-9ddd-bd16541495b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:08.321814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1291/2610] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:14.937393 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:14.946193 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad755157-e43e-4e1e-b6ab-a86853c6769a service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:14.949929 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c713747-0d1a-4950-9beb-8cde3dec6385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:14.950526 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713747-0d1a-4950-9beb-8cde3dec6385 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:14.950808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713747-0d1a-4950-9beb-8cde3dec6385 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:14.951100 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713747-0d1a-4950-9beb-8cde3dec6385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:14.952873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7c713747-0d1a-4950-9beb-8cde3dec6385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:14.966782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c713747-0d1a-4950-9beb-8cde3dec6385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:14.968238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c713747-0d1a-4950-9beb-8cde3dec6385 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:14.979901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1320/2611] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:18.306309 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:19.023765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df08f5f-cc6f-4005-9ddd-bd16541495b7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:19.033315 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df08f5f-cc6f-4005-9ddd-bd16541495b7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:19.037647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:19.038208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:19.038483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:19.038747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:19.040492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:19.100045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:19.101486 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:19.110556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1292/2612] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:24.974948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=40 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:25.646974 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025281b5-00b8-43d0-8b0b-9dcb8cadd6c7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:25.647264 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025281b5-00b8-43d0-8b0b-9dcb8cadd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:25.647667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025281b5-00b8-43d0-8b0b-9dcb8cadd6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:25.668618 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-025281b5-00b8-43d0-8b0b-9dcb8cadd6c7 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:25.669848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-025281b5-00b8-43d0-8b0b-9dcb8cadd6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:25.739025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1321/2613] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:25.910356 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:25.911653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:26.012717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68369b6-e8af-4bc6-9dd5-2f904f166904 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:26.025217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb4da8-25db-4b0e-83df-9dc895f66d54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:26.025217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4da8-25db-4b0e-83df-9dc895f66d54 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:26.025217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4da8-25db-4b0e-83df-9dc895f66d54 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:26.025217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4da8-25db-4b0e-83df-9dc895f66d54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:26.043951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb4da8-25db-4b0e-83df-9dc895f66d54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:26.046078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb4da8-25db-4b0e-83df-9dc895f66d54 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:26.056968 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1293/2614] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 21:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:03:28.340127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025281b5-00b8-43d0-8b0b-9dcb8cadd6c7 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:28.359707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025281b5-00b8-43d0-8b0b-9dcb8cadd6c7 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:28.376340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:28.377239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:28.378459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:28.380623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:28.383776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:28.419062 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:28.421971 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:28.436241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1322/2615] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:36.053444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=60 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:37.754615 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:37.755510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:37.755674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:37.872952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:37.875804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:37.920662 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1294/2616] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:37.934430 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:37.955044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4006b-27b4-424f-82d3-964b32baa445 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:37.961245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:37.961934 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:37.962223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:37.962532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:37.981848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:37.984842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:37.997610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1323/2617] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 21:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:03:38.690030 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:38.691690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:38.720037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dc579-6a16-4d0f-83c8-2f05e6607012 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:38.725212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:38.726371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:38.726830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:38.727139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] PATH_INFO: `/v3/users/72e153ab64294e518c3ce4ac03077ab8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:38.729059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e153ab64294e518c3ce4ac03077ab8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:38.731533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:39.021608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e153ab64294e518c3ce4ac03077ab8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:39.023069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e153ab64294e518c3ce4ac03077ab8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:39.030994 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e153ab64294e518c3ce4ac03077ab8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:39.031685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e153ab64294e518c3ce4ac03077ab8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:39.049422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e153ab64294e518c3ce4ac03077ab8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:39.193213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1295/2618] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:03:38 2022] DELETE /identity/v3/users/72e153ab64294e518c3ce4ac03077ab8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:03:39.608734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:39.620611 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60d61-6729-44d8-aac5-0a1217013f64 service swift] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:39.695145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:39.696372 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:39.696835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:39.697270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] PATH_INFO: `/v3/projects/209bb8eb567b434088d163ae1eafe79c` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:39.698683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209bb8eb567b434088d163ae1eafe79c)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:39.701375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:39.828636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209bb8eb567b434088d163ae1eafe79c', 'request_id': 'req-121e7e41-d1a1-4399-a2ec-88a9f6426656'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:39.842491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209bb8eb567b434088d163ae1eafe79c', 'request_id': 'req-121e7e41-d1a1-4399-a2ec-88a9f6426656'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.035133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209bb8eb567b434088d163ae1eafe79c', 'request_id': 'req-121e7e41-d1a1-4399-a2ec-88a9f6426656'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.052962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] The token cache is being invalidate because project 209bb8eb567b434088d163ae1eafe79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:03:40.053186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.056139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.056282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1324/2619] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:03:39 2022] DELETE /identity/v3/projects/209bb8eb567b434088d163ae1eafe79c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:03:40.061584 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:40.064747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:40.080223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bd032-e285-4dc6-a1a1-39615052d21b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:40.174632 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:40.175273 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:40.175590 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:40.175884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] PATH_INFO: `/v3/users/42eeaf7c558b4d50b84d7f155a812f77` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:40.177267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42eeaf7c558b4d50b84d7f155a812f77)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:40.179518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:40.474710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:40.487832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42eeaf7c558b4d50b84d7f155a812f77'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.488804 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42eeaf7c558b4d50b84d7f155a812f77'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.498539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42eeaf7c558b4d50b84d7f155a812f77'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.499903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42eeaf7c558b4d50b84d7f155a812f77'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.517735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-578d1c62-320f-406c-95ce-b68a7b837e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42eeaf7c558b4d50b84d7f155a812f77'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:40.651497 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1296/2620] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:03:40 2022] DELETE /identity/v3/users/42eeaf7c558b4d50b84d7f155a812f77 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:03:41.026651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:41.028532 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:41.046992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7e41-d1a1-4399-a2ec-88a9f6426656 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:41.053187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:41.122548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:41.123350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:41.123690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:41.124016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] PATH_INFO: `/v3/projects/36221a3e487d4217b763372469a60596` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:41.125215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36221a3e487d4217b763372469a60596)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:41.127282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:41.438484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36221a3e487d4217b763372469a60596', 'request_id': 'req-8b83bd77-db6b-44a9-ae13-9cba97502c5a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:41.446473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36221a3e487d4217b763372469a60596', 'request_id': 'req-8b83bd77-db6b-44a9-ae13-9cba97502c5a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:41.538635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36221a3e487d4217b763372469a60596', 'request_id': 'req-8b83bd77-db6b-44a9-ae13-9cba97502c5a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:41.554507 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] The token cache is being invalidate because project 36221a3e487d4217b763372469a60596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:03:41.554800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:41.555768 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-8b83bd77-db6b-44a9-ae13-9cba97502c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:03:41.575431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1325/2621] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:03:41 2022] DELETE /identity/v3/projects/36221a3e487d4217b763372469a60596 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:03:45.745511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414bbc-67ae-437f-b241-60790d7789f5 None None] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:45.746394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414bbc-67ae-437f-b241-60790d7789f5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:45.746788 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414bbc-67ae-437f-b241-60790d7789f5 None None] PATH_INFO: `/` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:45.748355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1297/2622] 10.222.0.62 () {54 vars in 921 bytes} [Thu Aug 18 21:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:45.754294 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:45.754843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:45.754843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:45.814709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] MFA Rules not processed for user `79b9a470bced4efcaef3ed849f6963fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:45.814709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:45.911022 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1326/2623] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Aug 18 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:03:45.923821 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e414bbc-67ae-437f-b241-60790d7789f5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:45.925928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5e414bbc-67ae-437f-b241-60790d7789f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:46.011209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e414bbc-67ae-437f-b241-60790d7789f5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:46.016196 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad93c9-1d39-4aff-8437-4047533435bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:46.017002 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad93c9-1d39-4aff-8437-4047533435bf service glance] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:46.017406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad93c9-1d39-4aff-8437-4047533435bf service glance] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:46.017681 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad93c9-1d39-4aff-8437-4047533435bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:46.036324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad93c9-1d39-4aff-8437-4047533435bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:46.037957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad93c9-1d39-4aff-8437-4047533435bf service glance] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:46.051456 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1298/2624] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:48.352160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:48.357680 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:48.386999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:48.441745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5c20-6827-4adb-97db-44f37f98dc3e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:48.445944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:48.446781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:48.447134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:48.447643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:48.449649 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:48.463094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:48.465313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:48.476660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1327/2625] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:49.555270 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a92ab-3691-4a2a-9134-9ce0933bcc1a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:49.555799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a92ab-3691-4a2a-9134-9ce0933bcc1a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:49.555902 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a92ab-3691-4a2a-9134-9ce0933bcc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:49.581720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-954a92ab-3691-4a2a-9134-9ce0933bcc1a None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:49.581720 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-954a92ab-3691-4a2a-9134-9ce0933bcc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:49.651854 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1299/2626] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Aug 18 21:03:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:49.672870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:49.675819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:49.799996 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78858e-8770-4a6c-b26b-f8d2c1b2d51b service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:49.808054 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:49.809126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:49.809444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:49.809852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:49.823066 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:49.824881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:49.835113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1328/2627] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 21:03:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 21:03:56.614619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b076c-5234-4742-a841-68739aa80168 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:56.615149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b076c-5234-4742-a841-68739aa80168 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:56.615715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b076c-5234-4742-a841-68739aa80168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:56.640798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-332b076c-5234-4742-a841-68739aa80168 None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:56.642029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-332b076c-5234-4742-a841-68739aa80168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:56.649964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1300/2628] 10.222.0.62 () {58 vars in 967 bytes} [Thu Aug 18 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:56.662360 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:56.674560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec65c4-4dd5-4b72-9f7b-c52f7e11d5fa service swift] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:56.680079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:56.680886 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:56.681171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:56.681448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:56.691561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:56.693730 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:56.705005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1329/2629] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 21:03:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:01.458946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b076c-5234-4742-a841-68739aa80168 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:01.460597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-332b076c-5234-4742-a841-68739aa80168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:01.541090 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:01.561263 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b076c-5234-4742-a841-68739aa80168 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:01.566885 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:01.567574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:01.567859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:01.568710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] PATH_INFO: `/v3/users/d1b36de9654d42a685c96ec7ea6608f3` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:01.569922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b36de9654d42a685c96ec7ea6608f3)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:01.572174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:01.935405 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b36de9654d42a685c96ec7ea6608f3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:01.936041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b36de9654d42a685c96ec7ea6608f3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:01.943149 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b36de9654d42a685c96ec7ea6608f3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:01.943878 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b36de9654d42a685c96ec7ea6608f3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:01.958066 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2c38ec1-7ede-4bdc-9b23-b27c5ba282be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b36de9654d42a685c96ec7ea6608f3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:02.029269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1301/2630] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:04:01 2022] DELETE /identity/v3/users/d1b36de9654d42a685c96ec7ea6608f3 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:02.275418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:02.289380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31b38b-f3cf-4e71-a73a-61358876d46c service swift] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:02.358831 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:02.359658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:02.360048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:02.360431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] PATH_INFO: `/v3/projects/32366eaaa6d342adb39c9175a121324a` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:02.361737 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32366eaaa6d342adb39c9175a121324a)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:02.363820 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:02.386206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:02.468981 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32366eaaa6d342adb39c9175a121324a', 'request_id': 'req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:02.474753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32366eaaa6d342adb39c9175a121324a', 'request_id': 'req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:02.555731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32366eaaa6d342adb39c9175a121324a', 'request_id': 'req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:02.567772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] The token cache is being invalidate because project 32366eaaa6d342adb39c9175a121324a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:04:02.569563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:02.569563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-9b621b0d-ec10-40c3-bcc4-9c93ccbc399c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:02.570232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1330/2631] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:04:02 2022] DELETE /identity/v3/projects/32366eaaa6d342adb39c9175a121324a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:02.577144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917839-3ea4-4866-b7ca-3833c8b0dbb5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:02.577683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917839-3ea4-4866-b7ca-3833c8b0dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:02.577683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917839-3ea4-4866-b7ca-3833c8b0dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:02.597176 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-88917839-3ea4-4866-b7ca-3833c8b0dbb5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:02.598425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-88917839-3ea4-4866-b7ca-3833c8b0dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:02.660703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1302/2632] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:02.674544 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7596d-4897-4608-a01d-fa8d436ae34e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:02.675419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7596d-4897-4608-a01d-fa8d436ae34e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:02.675617 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7596d-4897-4608-a01d-fa8d436ae34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:02.702566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e2c7596d-4897-4608-a01d-fa8d436ae34e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:02.703822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e2c7596d-4897-4608-a01d-fa8d436ae34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:02.711961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1331/2633] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:02.716300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88917839-3ea4-4866-b7ca-3833c8b0dbb5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:02.726647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88917839-3ea4-4866-b7ca-3833c8b0dbb5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:02.731266 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:02.731923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:02.732203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:02.732475 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:02.733128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:02.733439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:02.735043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:02.748139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1303/2634] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:02.752782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7596d-4897-4608-a01d-fa8d436ae34e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:02.763593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7596d-4897-4608-a01d-fa8d436ae34e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:02.767879 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:02.768499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:02.768782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:02.769059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:02.769696 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:02.771638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:02.881853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1332/2635] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:04:02 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:02.883479 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:02.896545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1def-3d07-4491-b222-511729bea713 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:02.959238 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:02.960449 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:02.960728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:02.960996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:02.961620 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:02.963561 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:02.971710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:03.098352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1304/2636] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:04:02 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:03.103014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:03.113739 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87261-7eae-4e15-8e4e-23f7d54953fb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:03.118862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:03.119517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.119798 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.120068 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.120710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:03.122313 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:03.133271 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1333/2637] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:03.137449 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:03.148432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8696-e5da-466c-afcc-6ef5b03aed37 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:03.153587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ecab1-6cc2-4134-a7e3-ad30691f1f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:03.154182 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ecab1-6cc2-4134-a7e3-ad30691f1f74 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.157979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ecab1-6cc2-4134-a7e3-ad30691f1f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.157979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ecab1-6cc2-4134-a7e3-ad30691f1f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.157979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ecab1-6cc2-4134-a7e3-ad30691f1f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:03.157979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ecab1-6cc2-4134-a7e3-ad30691f1f74 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:03.168866 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1305/2638] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:03.173166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:03.184021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b98c-0d6c-4e15-a781-bdccc5ecf6d9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:03.189459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:03.192636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.192636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.192636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] PATH_INFO: `/v3/projects/4f044aa368374bfdbbe67eef66b02b28/users/e9c8beca893f40f08befa76dd712285f/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.206635 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f044aa368374bfdbbe67eef66b02b28, user_id=e9c8beca893f40f08befa76dd712285f, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:03.210012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:03.298597 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1334/2639] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:04:03 2022] PUT /identity/v3/projects/4f044aa368374bfdbbe67eef66b02b28/users/e9c8beca893f40f08befa76dd712285f/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:03.303733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85873-fc18-436d-8964-ada45bce299a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.304020 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85873-fc18-436d-8964-ada45bce299a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.304303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85873-fc18-436d-8964-ada45bce299a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.325679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-88f85873-fc18-436d-8964-ada45bce299a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:03.326918 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-88f85873-fc18-436d-8964-ada45bce299a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:03.388487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1306/2640] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:03.398758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:03.400584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:03.464198 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd38f8-b080-4963-af08-6f8e1facabf0 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:03.467876 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:03.468490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:03.468775 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:03.469047 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:03.478750 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:03.480233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:03.489999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1335/2641] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:04:09.862327 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aac66-255f-4c6d-a56d-d8e8d22bd0be None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:09.862775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aac66-255f-4c6d-a56d-d8e8d22bd0be None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:09.862775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aac66-255f-4c6d-a56d-d8e8d22bd0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:09.891811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-393aac66-255f-4c6d-a56d-d8e8d22bd0be None None] MFA Rules not processed for user `e9c8beca893f40f08befa76dd712285f`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:09.893059 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-393aac66-255f-4c6d-a56d-d8e8d22bd0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:09.997767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1307/2642] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:10.002245 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:10.012959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cac7b6-ff17-42b5-838a-c68e7ac7acbf service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:10.017826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:10.018539 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:10.018900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:10.019241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:10.020010 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:10.022603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:10.109682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1336/2643] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:04:10 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:10.113718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aac66-255f-4c6d-a56d-d8e8d22bd0be None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:10.125154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aac66-255f-4c6d-a56d-d8e8d22bd0be None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:10.187443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:10.188071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:10.188347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:10.188669 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:10.189552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:10.191485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:10.264757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:10.271629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1308/2644] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:04:10 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:10.276202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:10.287494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d2eae-5210-4d9f-8760-94a56053404a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:10.293792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:10.294454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:10.294738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:10.295020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:10.295788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:10.297423 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:10.310333 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1337/2645] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:10.314204 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:10.326706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143073-0df8-4c65-a344-35f222f3362b admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:10.331842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:10.332544 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:10.334113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:10.334113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] PATH_INFO: `/v3/projects/a6d14f7fc5b04efcabbfb8042fb4f89f/users/6cf4cf25df9a41a791dd4923e2812479/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:10.351031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d14f7fc5b04efcabbfb8042fb4f89f, user_id=6cf4cf25df9a41a791dd4923e2812479, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:10.354271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:10.433812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1309/2646] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:04:10 2022] PUT /identity/v3/projects/a6d14f7fc5b04efcabbfb8042fb4f89f/users/6cf4cf25df9a41a791dd4923e2812479/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:10.437777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:10.446895 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:10.452154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba2fed-67fb-4491-9abc-c918df632889 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:10.519255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb1de5-485a-400b-bcd6-93c3d6c14c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:10.519921 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1de5-485a-400b-bcd6-93c3d6c14c14 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:10.520221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1de5-485a-400b-bcd6-93c3d6c14c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:10.520475 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1de5-485a-400b-bcd6-93c3d6c14c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:10.521136 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb1de5-485a-400b-bcd6-93c3d6c14c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:10.523406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb1de5-485a-400b-bcd6-93c3d6c14c14 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:10.542759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1338/2647] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:10.544391 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:10.556221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82b8e0-b03b-454f-a04d-b9746f5fcc77 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:10.561272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:10.566833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:10.566833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:10.566833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] PATH_INFO: `/v3/projects/a6d14f7fc5b04efcabbfb8042fb4f89f/users/6cf4cf25df9a41a791dd4923e2812479/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:10.569587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d14f7fc5b04efcabbfb8042fb4f89f, user_id=6cf4cf25df9a41a791dd4923e2812479, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:10.573656 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:10.609523 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1310/2648] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:04:10 2022] PUT /identity/v3/projects/a6d14f7fc5b04efcabbfb8042fb4f89f/users/6cf4cf25df9a41a791dd4923e2812479/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:13.297606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba51a5-44bd-4f16-977c-7a162cc1833d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:13.298134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba51a5-44bd-4f16-977c-7a162cc1833d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:13.298233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba51a5-44bd-4f16-977c-7a162cc1833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:13.370654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-06ba51a5-44bd-4f16-977c-7a162cc1833d None None] MFA Rules not processed for user `75c6915ce17943a4b9c6c5f4a166a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:13.376939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-06ba51a5-44bd-4f16-977c-7a162cc1833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:13.477161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1339/2649] 10.222.0.62 () {58 vars in 967 bytes} [Thu Aug 18 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:04:13.491172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:13.494606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:13.639653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbb934-23c3-477f-b875-414f46a0d472 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:13.650652 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7bfd9c93404d8ea4260832d1b0e284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:13.651576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:13.651924 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:13.652389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:13.664844 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:13.666983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:13.677817 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1311/2650] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Aug 18 21:04:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:16.936036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9683c7-dabd-4f5e-ad57-598c85d9e5c9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:16.936559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9683c7-dabd-4f5e-ad57-598c85d9e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:16.940248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9683c7-dabd-4f5e-ad57-598c85d9e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:16.977936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-bf9683c7-dabd-4f5e-ad57-598c85d9e5c9 None None] MFA Rules not processed for user `6cf4cf25df9a41a791dd4923e2812479`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:16.979183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bf9683c7-dabd-4f5e-ad57-598c85d9e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:17.063216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1340/2651] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:17.077913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:17.079519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:17.162344 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bc4b2-30be-4484-a4c7-4ab6aa629914 service swift] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:17.168223 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:17.169140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:17.169424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:17.169699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:17.217638 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:17.229705 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:17.231201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:17.242231 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1312/2652] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:27.059872 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=86 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:27.304477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:37.132673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9683c7-dabd-4f5e-ad57-598c85d9e5c9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:37.191383 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9683c7-dabd-4f5e-ad57-598c85d9e5c9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:37.195940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:37.196551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:37.196832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:37.197112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:37.198875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:37.267171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:37.268738 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:37.279074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1341/2653] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:04:41.070162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:41.072730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:41.091102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ff886-f2e7-4c5a-b2d7-a9247d004840 service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:41.097530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:41.098179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:41.098461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:41.098731 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] PATH_INFO: `/v3/users/b5b5dd3c92034837921826c9b2dea76b` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:41.114591 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b5dd3c92034837921826c9b2dea76b)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:41.116697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:41.276832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b5dd3c92034837921826c9b2dea76b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:41.277468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b5dd3c92034837921826c9b2dea76b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:41.287627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b5dd3c92034837921826c9b2dea76b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:41.288490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b5dd3c92034837921826c9b2dea76b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:41.304796 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fdf865e9-3874-4ead-9219-87b65c725bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b5dd3c92034837921826c9b2dea76b'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:41.359826 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1313/2654] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:04:41 2022] DELETE /identity/v3/users/b5b5dd3c92034837921826c9b2dea76b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:41.666678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:41.679091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb75a2-a318-42be-abf9-1d38351781e1 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:41.747312 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:41.748015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:41.748277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:41.748567 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] PATH_INFO: `/v3/projects/abf631fcae584ce1a0b8c26560398cea` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:41.761562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf631fcae584ce1a0b8c26560398cea)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:41.763600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:41.886478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:41.891410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf631fcae584ce1a0b8c26560398cea', 'request_id': 'req-bcec1edc-3034-4fef-90e5-383db7fa7414'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:41.899126 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf631fcae584ce1a0b8c26560398cea', 'request_id': 'req-bcec1edc-3034-4fef-90e5-383db7fa7414'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:42.029161 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf631fcae584ce1a0b8c26560398cea', 'request_id': 'req-bcec1edc-3034-4fef-90e5-383db7fa7414'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:42.042569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] The token cache is being invalidate because project abf631fcae584ce1a0b8c26560398cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:04:42.043038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:42.043734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bcec1edc-3034-4fef-90e5-383db7fa7414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:42.045254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1342/2655] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:04:41 2022] DELETE /identity/v3/projects/abf631fcae584ce1a0b8c26560398cea => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:04:42.050446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710292d-c00e-4f80-8d63-2102579eff2a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.050797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710292d-c00e-4f80-8d63-2102579eff2a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.051116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710292d-c00e-4f80-8d63-2102579eff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.072462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-3710292d-c00e-4f80-8d63-2102579eff2a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:42.073747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3710292d-c00e-4f80-8d63-2102579eff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:42.135006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1314/2656] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:42.142653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb0370-f975-424e-b6f8-ecf956fa6103 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.143057 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb0370-f975-424e-b6f8-ecf956fa6103 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.143395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb0370-f975-424e-b6f8-ecf956fa6103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.164133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-22bb0370-f975-424e-b6f8-ecf956fa6103 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:42.168917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-22bb0370-f975-424e-b6f8-ecf956fa6103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:42.173670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1343/2657] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:42.178768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710292d-c00e-4f80-8d63-2102579eff2a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:42.189329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710292d-c00e-4f80-8d63-2102579eff2a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:42.194185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:42.198799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.198799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.198799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.198799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:42.198799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:42.198799 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:42.211180 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1315/2658] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:42.216012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb0370-f975-424e-b6f8-ecf956fa6103 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:42.227433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb0370-f975-424e-b6f8-ecf956fa6103 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:42.230804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:42.231458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.231734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.232011 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.232683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:42.234643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:42.358531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1344/2659] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:42.362919 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:42.374533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9f82-0f37-46c5-a7af-e99d062a9524 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:42.422833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:42.435861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:42.436480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.436763 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.437082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.437718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:42.439701 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:42.612685 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1316/2660] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:04:42 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:42.617377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:42.629546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ed02d-8fba-4f1d-8639-7cf9d37ef719 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:42.634451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:42.635064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.635342 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.635645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.636295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:42.637898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:42.649296 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1345/2661] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:42.653970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:42.665478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d0d0-a10c-43f9-b94a-e471a806ccbc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:42.670138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a52d1-eb47-4525-ac53-ab201076bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:42.670749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a52d1-eb47-4525-ac53-ab201076bf87 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.671031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a52d1-eb47-4525-ac53-ab201076bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.671338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a52d1-eb47-4525-ac53-ab201076bf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.672010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a52d1-eb47-4525-ac53-ab201076bf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:42.673626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a52d1-eb47-4525-ac53-ab201076bf87 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:42.685425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1317/2662] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:42.689529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:42.700291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44912626-8adb-433a-9cc3-3d858534aac7 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:42.705287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:42.706016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.706335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.706663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] PATH_INFO: `/v3/projects/c3e8a5687fa544fe85761a5042186888/users/48326ec735f547d592fed6c4dd6ed88a/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.724078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e8a5687fa544fe85761a5042186888, user_id=48326ec735f547d592fed6c4dd6ed88a, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:42.727351 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:42.841978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1346/2663] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:04:42 2022] PUT /identity/v3/projects/c3e8a5687fa544fe85761a5042186888/users/48326ec735f547d592fed6c4dd6ed88a/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:42.853545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de328f-0596-42c4-9c8b-c5b4d15768f5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.853835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de328f-0596-42c4-9c8b-c5b4d15768f5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.854117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de328f-0596-42c4-9c8b-c5b4d15768f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.884856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-d1de328f-0596-42c4-9c8b-c5b4d15768f5 None None] MFA Rules not processed for user `48326ec735f547d592fed6c4dd6ed88a`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:42.886026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-d1de328f-0596-42c4-9c8b-c5b4d15768f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:42.958797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1318/2664] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:42.971117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:42.972949 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:43.053194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964cac-7ab6-48d6-b84b-b651e950d97f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:43.060693 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:43.061715 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:43.062278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:43.062799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:43.078093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:43.081133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:43.092444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1347/2665] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:04:43.148440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:43.149005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:43.149005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:43.168443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] MFA Rules not processed for user `e9c8beca893f40f08befa76dd712285f`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:43.169655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:43.225283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1319/2666] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:43.570948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:43.572520 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:43.636874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ca52-2348-4340-a676-0fdd2c55e345 service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:43.640861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:43.641510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:43.641792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:43.642069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:43.644159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:43.652736 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:43.655844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:43.657039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:43.665928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1348/2667] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:04:44.492578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:44.494140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:44.565341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:44.570380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1642a-f258-4969-8fc7-a3baf736375f None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:44.575538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93470-fb4b-48e9-8d5c-8e3f86ab4cae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:44.576142 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93470-fb4b-48e9-8d5c-8e3f86ab4cae service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:44.576418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93470-fb4b-48e9-8d5c-8e3f86ab4cae service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:44.579820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93470-fb4b-48e9-8d5c-8e3f86ab4cae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:44.579820 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-87e93470-fb4b-48e9-8d5c-8e3f86ab4cae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:44.590931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e93470-fb4b-48e9-8d5c-8e3f86ab4cae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:44.592519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e93470-fb4b-48e9-8d5c-8e3f86ab4cae service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:44.603671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1320/2668] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:53.458561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:53.526657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d34556-898f-4156-86b6-c67311ad436d service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:53.531159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:53.531827 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:53.532112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:53.532388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] PATH_INFO: `/v3/users/48326ec735f547d592fed6c4dd6ed88a` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:53.533554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=48326ec735f547d592fed6c4dd6ed88a)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:53.535868 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:53.848764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48326ec735f547d592fed6c4dd6ed88a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:53.856440 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48326ec735f547d592fed6c4dd6ed88a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:53.857145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48326ec735f547d592fed6c4dd6ed88a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:53.869517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48326ec735f547d592fed6c4dd6ed88a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:53.947124 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48326ec735f547d592fed6c4dd6ed88a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:53.953826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1349/2669] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:04:53 2022] DELETE /identity/v3/users/48326ec735f547d592fed6c4dd6ed88a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:04:53.958515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:53.959055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:53.959055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:53.979323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:53.980578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:54.041619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1321/2670] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:54.051331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:54.052780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:54.111151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4d76-796c-47e4-8db2-3e079499eaba admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:54.114728 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1084-2ddc-45d2-8685-8bb10877af5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:54.115420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1084-2ddc-45d2-8685-8bb10877af5b service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:54.115677 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1084-2ddc-45d2-8685-8bb10877af5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:54.115948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1084-2ddc-45d2-8685-8bb10877af5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:54.125331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1084-2ddc-45d2-8685-8bb10877af5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:54.126777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1084-2ddc-45d2-8685-8bb10877af5b service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:54.136848 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1350/2671] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:54.562268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:54.563795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:54.576840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fce3-9427-41b0-9782-239d485112b6 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:54.582151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:54.582867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:54.583212 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:54.583592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] PATH_INFO: `/v3/projects/c3e8a5687fa544fe85761a5042186888` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:54.585331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e8a5687fa544fe85761a5042186888)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:54.587672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:54.694535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e8a5687fa544fe85761a5042186888', 'request_id': 'req-e4692cd8-edaf-4037-8aa6-0c276c1c1468'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:54.700336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e8a5687fa544fe85761a5042186888', 'request_id': 'req-e4692cd8-edaf-4037-8aa6-0c276c1c1468'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:54.775329 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e8a5687fa544fe85761a5042186888', 'request_id': 'req-e4692cd8-edaf-4037-8aa6-0c276c1c1468'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:54.788752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] The token cache is being invalidate because project c3e8a5687fa544fe85761a5042186888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:04:54.792663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:54.792663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e4692cd8-edaf-4037-8aa6-0c276c1c1468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:04:54.792663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1322/2672] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:04:54 2022] DELETE /identity/v3/projects/c3e8a5687fa544fe85761a5042186888 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:54.796421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490df12-6c2f-4cf1-973c-713b6c81cea6 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:54.796900 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490df12-6c2f-4cf1-973c-713b6c81cea6 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:54.797209 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490df12-6c2f-4cf1-973c-713b6c81cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:54.817382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a490df12-6c2f-4cf1-973c-713b6c81cea6 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:54.821374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a490df12-6c2f-4cf1-973c-713b6c81cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:54.831829 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:54.890689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1351/2673] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:54.899052 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb10bf-1cf9-4158-92f2-5ce610b4ce06 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:54.899331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb10bf-1cf9-4158-92f2-5ce610b4ce06 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:54.899663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb10bf-1cf9-4158-92f2-5ce610b4ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:54.921514 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-85fb10bf-1cf9-4158-92f2-5ce610b4ce06 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:54.923010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-85fb10bf-1cf9-4158-92f2-5ce610b4ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:54.931400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1323/2674] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:54.935908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490df12-6c2f-4cf1-973c-713b6c81cea6 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:54.947133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490df12-6c2f-4cf1-973c-713b6c81cea6 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:54.953658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:54.954306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:54.954588 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:54.954854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:54.955557 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:04:54.955865 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:54.957592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:54.971490 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1352/2675] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:04:54.976451 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb10bf-1cf9-4158-92f2-5ce610b4ce06 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:54.986557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb10bf-1cf9-4158-92f2-5ce610b4ce06 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:54.991579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:54.992198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:54.992481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:54.992949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:54.993614 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:54.995604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.120296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1324/2676] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:04:54 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:55.124666 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.135274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c96b8-1c33-4c16-afa5-9c23d645135d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.192906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.193442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.194290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.194565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.195207 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:55.197231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.291260 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1353/2677] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:04:55 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:04:55.296626 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.308465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b44b4-20ad-49eb-9119-bfaf5f4ba66f admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.314305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.314966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.315248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.315557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.316207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:55.322444 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.328883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1325/2678] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:55.332941 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.343560 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0cdf1-1fe1-4250-8da9-7a520e483ef7 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.350146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988924ae-78c7-4a1b-94cd-dd422acad324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.351285 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988924ae-78c7-4a1b-94cd-dd422acad324 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.351734 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988924ae-78c7-4a1b-94cd-dd422acad324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.352153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988924ae-78c7-4a1b-94cd-dd422acad324 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.353141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988924ae-78c7-4a1b-94cd-dd422acad324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:55.355081 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988924ae-78c7-4a1b-94cd-dd422acad324 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.368029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1354/2679] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:55.372577 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.384707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6b6e-a6b1-4b67-89b2-c92ce7cadbc3 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.392922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.393651 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.393937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.394371 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] PATH_INFO: `/v3/projects/689c3da48a11465e8fbc9fa55e7f5007/users/855872aac1504e13b74530a01ea57185/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.411239 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689c3da48a11465e8fbc9fa55e7f5007, user_id=855872aac1504e13b74530a01ea57185, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:55.413934 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.479207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1326/2680] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:04:55 2022] PUT /identity/v3/projects/689c3da48a11465e8fbc9fa55e7f5007/users/855872aac1504e13b74530a01ea57185/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:55.491498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2193c94-d164-4732-b502-5ba1332e6511 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.491780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2193c94-d164-4732-b502-5ba1332e6511 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.492051 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2193c94-d164-4732-b502-5ba1332e6511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.521553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a2193c94-d164-4732-b502-5ba1332e6511 None None] MFA Rules not processed for user `855872aac1504e13b74530a01ea57185`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:55.522809 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a2193c94-d164-4732-b502-5ba1332e6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:55.590667 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1355/2681] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:55.595324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.612010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:55.659597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f3e79-f09b-402a-924f-38cec8ffdb83 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.665623 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.666341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.666608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.666880 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.667589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:55.669653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.750609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1327/2682] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:04:55 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:04:55.754849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2193c94-d164-4732-b502-5ba1332e6511 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.766117 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2193c94-d164-4732-b502-5ba1332e6511 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.775849 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:55.826773 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.827476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.827712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.827987 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.828641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:55.830634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.932754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1356/2683] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:04:55 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:04:55.937036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.947757 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d8604-7669-4018-b740-aa7e63cf5f61 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.952641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.953253 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.953556 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.953841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.954490 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:55.956169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:55.967547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1328/2684] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:04:55.971945 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:55.983227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef0fd-7c29-46a9-a9da-946df03b25e0 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:55.988278 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:55.989009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.989289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.989564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] PATH_INFO: `/v3/projects/57e7b15096e644238d5b67c06d0fc4a0/users/e3b36f7d83c34dc4ba7acf2f87dc692c/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:56.009594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e7b15096e644238d5b67c06d0fc4a0, user_id=e3b36f7d83c34dc4ba7acf2f87dc692c, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:56.012437 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:56.080692 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1357/2685] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:04:55 2022] PUT /identity/v3/projects/57e7b15096e644238d5b67c06d0fc4a0/users/e3b36f7d83c34dc4ba7acf2f87dc692c/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:56.085420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:56.096394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f2a8-e92c-4cf4-8cfa-23068aaa9db9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:56.155810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a5ff-6729-4fe8-8246-7151d202df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:56.156432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a5ff-6729-4fe8-8246-7151d202df4b admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:56.156715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a5ff-6729-4fe8-8246-7151d202df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:56.156990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a5ff-6729-4fe8-8246-7151d202df4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:56.157641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a5ff-6729-4fe8-8246-7151d202df4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:56.159315 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a5ff-6729-4fe8-8246-7151d202df4b admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:56.172131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1329/2686] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:04:56.176575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:56.187102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af5b91-2825-4866-8432-71a007fb3cd3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:56.191801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:56.192462 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:56.192744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:56.193019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] PATH_INFO: `/v3/projects/57e7b15096e644238d5b67c06d0fc4a0/users/e3b36f7d83c34dc4ba7acf2f87dc692c/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:56.194952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e7b15096e644238d5b67c06d0fc4a0, user_id=e3b36f7d83c34dc4ba7acf2f87dc692c, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:56.197643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:56.208005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1358/2687] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:04:56 2022] PUT /identity/v3/projects/57e7b15096e644238d5b67c06d0fc4a0/users/e3b36f7d83c34dc4ba7acf2f87dc692c/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:04:56.220550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff7ad5-2e3d-4d28-80b1-4e26b53a4755 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:56.220939 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff7ad5-2e3d-4d28-80b1-4e26b53a4755 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:56.221104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff7ad5-2e3d-4d28-80b1-4e26b53a4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:56.257379 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-84ff7ad5-2e3d-4d28-80b1-4e26b53a4755 None None] MFA Rules not processed for user `e3b36f7d83c34dc4ba7acf2f87dc692c`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:56.258604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-84ff7ad5-2e3d-4d28-80b1-4e26b53a4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:56.329283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1330/2688] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:04:56.341638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:56.343352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:56.409079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200a98-0d4e-4287-94b0-e8086e021189 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:56.417778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:56.418596 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:56.418881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:56.419160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:56.429221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:56.430676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:56.440861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1359/2689] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:56.700641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff7ad5-2e3d-4d28-80b1-4e26b53a4755 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:56.711055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff7ad5-2e3d-4d28-80b1-4e26b53a4755 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:56.714775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:56.715589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:56.715879 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:56.716156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:56.720545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:56.782693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:56.784201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:56.795457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1331/2690] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:05.643045 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:05.644135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:05.741433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b09e9-526c-4843-9b66-e0a1274f0652 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:05.748176 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef202c1d-095f-4e34-bc87-d233e2ef03c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:05.748821 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef202c1d-095f-4e34-bc87-d233e2ef03c7 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:05.749091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef202c1d-095f-4e34-bc87-d233e2ef03c7 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:05.749365 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef202c1d-095f-4e34-bc87-d233e2ef03c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:05.751155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ef202c1d-095f-4e34-bc87-d233e2ef03c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:05.766222 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:05.766636 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef202c1d-095f-4e34-bc87-d233e2ef03c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:05.768298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef202c1d-095f-4e34-bc87-d233e2ef03c7 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:05.780568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1360/2691] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:06.828469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=25 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:08.787772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:08.854314 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb5d6-caf3-499b-8cc7-b0a5083d9513 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:08.858795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:08.859447 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:08.859729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:08.860000 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] PATH_INFO: `/v3/users/855872aac1504e13b74530a01ea57185` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:08.861125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855872aac1504e13b74530a01ea57185)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:08.863023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:09.076170 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855872aac1504e13b74530a01ea57185'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:09.076841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855872aac1504e13b74530a01ea57185'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:09.084450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855872aac1504e13b74530a01ea57185'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:09.085241 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855872aac1504e13b74530a01ea57185'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:09.104671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855872aac1504e13b74530a01ea57185'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:09.200389 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1332/2692] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:08 2022] DELETE /identity/v3/users/855872aac1504e13b74530a01ea57185 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:09.204923 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:09.205420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:09.205523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:09.225277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:09.227029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:09.297147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1361/2693] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:09.309324 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:09.311741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:09.376675 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b677d8-7cad-4467-80b1-fcc85636a243 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:09.380655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:09.381283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:09.381601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:09.381869 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:09.392032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:09.393506 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:09.403773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1333/2694] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:09.689630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:09.691203 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:09.705143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a544e56-6e2b-48f7-9691-24fb1a560b59 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:09.708819 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:09.709441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:09.710442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:09.710442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:09.712473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:09.787244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:09.789377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:09.800828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1362/2695] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:09.965154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:09.965154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:09.984533 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d74fce-fa6c-40d6-8df1-25188e0b8c72 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:09.999515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:09.999515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:09.999515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:09.999515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] PATH_INFO: `/v3/projects/689c3da48a11465e8fbc9fa55e7f5007` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:10.000472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689c3da48a11465e8fbc9fa55e7f5007)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:10.000472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:10.016255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:10.186841 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689c3da48a11465e8fbc9fa55e7f5007', 'request_id': 'req-e56f469e-e1b5-4f63-9da8-f32630e8eb75'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.195436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689c3da48a11465e8fbc9fa55e7f5007', 'request_id': 'req-e56f469e-e1b5-4f63-9da8-f32630e8eb75'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.261295 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689c3da48a11465e8fbc9fa55e7f5007', 'request_id': 'req-e56f469e-e1b5-4f63-9da8-f32630e8eb75'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.275261 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] The token cache is being invalidate because project 689c3da48a11465e8fbc9fa55e7f5007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:10.275599 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.276335 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.277891 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1334/2696] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:09 2022] DELETE /identity/v3/projects/689c3da48a11465e8fbc9fa55e7f5007 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:10.282159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:10.294179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7b57-68d0-4c4b-92e9-dad0043aee31 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:10.373493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:10.374152 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:10.374438 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:10.374720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] PATH_INFO: `/v3/users/e3b36f7d83c34dc4ba7acf2f87dc692c` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:10.376029 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b36f7d83c34dc4ba7acf2f87dc692c)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:10.378080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:10.572926 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:10.588764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b36f7d83c34dc4ba7acf2f87dc692c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.596364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b36f7d83c34dc4ba7acf2f87dc692c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.597141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b36f7d83c34dc4ba7acf2f87dc692c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.609243 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b36f7d83c34dc4ba7acf2f87dc692c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.691153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-4246a7cd-fb76-4258-9190-adf2deadeb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b36f7d83c34dc4ba7acf2f87dc692c'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:10.698355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1363/2697] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:10 2022] DELETE /identity/v3/users/e3b36f7d83c34dc4ba7acf2f87dc692c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:11.151883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:11.153630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:11.169579 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f469e-e1b5-4f63-9da8-f32630e8eb75 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:11.237755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:11.238397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:11.238679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:11.238950 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] PATH_INFO: `/v3/projects/57e7b15096e644238d5b67c06d0fc4a0` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:11.240112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e7b15096e644238d5b67c06d0fc4a0)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:11.242062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:11.399517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e7b15096e644238d5b67c06d0fc4a0', 'request_id': 'req-fac28650-0962-491e-9a3e-175b8db5a3f8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:11.407132 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e7b15096e644238d5b67c06d0fc4a0', 'request_id': 'req-fac28650-0962-491e-9a3e-175b8db5a3f8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:11.480658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e7b15096e644238d5b67c06d0fc4a0', 'request_id': 'req-fac28650-0962-491e-9a3e-175b8db5a3f8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:11.494219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] The token cache is being invalidate because project 57e7b15096e644238d5b67c06d0fc4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:11.494513 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:11.495607 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-fac28650-0962-491e-9a3e-175b8db5a3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:11.497572 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1335/2698] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:11 2022] DELETE /identity/v3/projects/57e7b15096e644238d5b67c06d0fc4a0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:11.502913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b77de-90cf-4a10-8d28-d70b30231b3b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:11.503518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b77de-90cf-4a10-8d28-d70b30231b3b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:11.503518 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b77de-90cf-4a10-8d28-d70b30231b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:11.525511 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-901b77de-90cf-4a10-8d28-d70b30231b3b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:11.526855 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-901b77de-90cf-4a10-8d28-d70b30231b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:11.602632 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1364/2699] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:11.610863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d609-c264-40ab-ba5f-5b67778ffdb5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:11.611144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d609-c264-40ab-ba5f-5b67778ffdb5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:11.611453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d609-c264-40ab-ba5f-5b67778ffdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:11.640123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-1b56d609-c264-40ab-ba5f-5b67778ffdb5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:11.641373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-1b56d609-c264-40ab-ba5f-5b67778ffdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:11.650713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1336/2700] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:11.655808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b77de-90cf-4a10-8d28-d70b30231b3b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:11.669744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b77de-90cf-4a10-8d28-d70b30231b3b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:11.674582 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:11.675232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:11.675548 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:11.675826 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:11.676494 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:11.676792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:11.678499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:11.691803 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1365/2701] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:11.696443 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56d609-c264-40ab-ba5f-5b67778ffdb5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:11.706259 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56d609-c264-40ab-ba5f-5b67778ffdb5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:11.712294 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:11.712996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:11.713282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:11.713552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:11.714222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:11.716163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:11.838478 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1337/2702] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:11 2022] POST /identity/v3/projects => generated 409 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:11.842965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:11.860933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7d0a7-4a00-4dbf-a269-30ef2f512921 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:11.938712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:11.939244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:11.939562 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:11.939835 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:11.940484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:11.942478 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.042323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1366/2703] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:11 2022] POST /identity/v3/users => generated 305 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:12.046608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.057583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e59da-adf2-4ea7-b6ed-a470c557e0b0 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.063013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.063722 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.063979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.064776 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.064910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.066517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.069116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:12.080942 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1338/2704] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:12.092291 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.103579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f588-fca9-4407-bc9b-8a8e3809cce0 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.108856 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.109489 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.109758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.110034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.110698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.112340 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.124442 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1367/2705] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:12.128964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.140708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82fcc-d504-4696-a075-84840f0c6950 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.146046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367d18b-007e-401b-8c99-e08e4d8c3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.152225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d18b-007e-401b-8c99-e08e4d8c3bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.152225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d18b-007e-401b-8c99-e08e4d8c3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.152225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d18b-007e-401b-8c99-e08e4d8c3bc0 admin admin] PATH_INFO: `/v3/projects/ce525e8a1b8843488f5083b0e3994fac/users/930d25db389444d7a78fcfad33cb6323/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.165744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367d18b-007e-401b-8c99-e08e4d8c3bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce525e8a1b8843488f5083b0e3994fac, user_id=930d25db389444d7a78fcfad33cb6323, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.169325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367d18b-007e-401b-8c99-e08e4d8c3bc0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.220206 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.225614 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:12.238014 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:12.251936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1339/2706] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:12 2022] PUT /identity/v3/projects/ce525e8a1b8843488f5083b0e3994fac/users/930d25db389444d7a78fcfad33cb6323/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:12.263692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2c7d-811e-415a-8e0b-8facd8ef01d3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.264242 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2c7d-811e-415a-8e0b-8facd8ef01d3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.265836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2c7d-811e-415a-8e0b-8facd8ef01d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.297903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-8e4c2c7d-811e-415a-8e0b-8facd8ef01d3 None None] MFA Rules not processed for user `930d25db389444d7a78fcfad33cb6323`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:12.298703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8e4c2c7d-811e-415a-8e0b-8facd8ef01d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:12.308989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239948f-9a82-453f-b18c-5d11c9e6a934 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.396838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.397484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.397767 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.398591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.400842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:12.413417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1340/2707] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:12.414740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.417049 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.417922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2c7d-811e-415a-8e0b-8facd8ef01d3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.429481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1368/2708] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:05:12.499005 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2c7d-811e-415a-8e0b-8facd8ef01d3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.505643 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.506932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.507396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.508459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.508984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.511546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.633985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1341/2709] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:12 2022] POST /identity/v3/projects => generated 407 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:12.638502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.651348 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03dd00-6f3a-4c65-8518-4bfc5a4caf3f service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.733604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.734149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.734436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.734710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.735392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.737568 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.834368 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1369/2710] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:12 2022] POST /identity/v3/users => generated 310 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:12.839200 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.850843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56f5a8-7b81-46da-adb5-139aa7b375ba admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.857274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.857274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.857274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.857274 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.858547 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.859384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.871997 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1342/2711] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:12.876598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:12.888683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7098a6-3268-4217-9bb2-8ef8f54aef09 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:12.894023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:12.894857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:12.895246 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:12.896355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] PATH_INFO: `/v3/projects/e310db7cb4be40e791e0dbd05b706489/users/8336301466bb4ec5babc2a1b85da9d47/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:12.916655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e310db7cb4be40e791e0dbd05b706489, user_id=8336301466bb4ec5babc2a1b85da9d47, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:12.919613 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:12.995815 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1370/2712] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:12 2022] PUT /identity/v3/projects/e310db7cb4be40e791e0dbd05b706489/users/8336301466bb4ec5babc2a1b85da9d47/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:12.999694 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:13.016532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d509-2197-4ad9-80a1-e02ef1f66977 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:13.057570 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:13.087045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91734-9d2e-43a8-ab56-1362ca648c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:13.088628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91734-9d2e-43a8-ab56-1362ca648c1f admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.088628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91734-9d2e-43a8-ab56-1362ca648c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.088628 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91734-9d2e-43a8-ab56-1362ca648c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.089105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91734-9d2e-43a8-ab56-1362ca648c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:13.090542 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91734-9d2e-43a8-ab56-1362ca648c1f admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:13.105062 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1343/2713] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:05:13.106552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:13.112763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:13.119612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebeb35-fff0-4402-9200-7c1bd328266a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:13.124717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:13.128906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.128906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.128906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] PATH_INFO: `/v3/projects/e310db7cb4be40e791e0dbd05b706489/users/8336301466bb4ec5babc2a1b85da9d47/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.128906 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e310db7cb4be40e791e0dbd05b706489, user_id=8336301466bb4ec5babc2a1b85da9d47, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:13.130807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:13.142543 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1371/2714] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:13 2022] PUT /identity/v3/projects/e310db7cb4be40e791e0dbd05b706489/users/8336301466bb4ec5babc2a1b85da9d47/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:13.154280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5740f5-df0b-45fb-b220-c2a327ad5bf5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.154819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5740f5-df0b-45fb-b220-c2a327ad5bf5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.154819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5740f5-df0b-45fb-b220-c2a327ad5bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.186189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-6c5740f5-df0b-45fb-b220-c2a327ad5bf5 None None] MFA Rules not processed for user `8336301466bb4ec5babc2a1b85da9d47`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:13.187484 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-6c5740f5-df0b-45fb-b220-c2a327ad5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:13.271339 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1344/2715] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:13.284890 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:13.286891 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:13.357137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caff5e-d8f9-4c56-816c-5bb79bf0e43c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:13.360910 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:13.361533 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.361816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.362092 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.371932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:13.373385 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:13.384433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1372/2716] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:13.784095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5740f5-df0b-45fb-b220-c2a327ad5bf5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:13.795021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5740f5-df0b-45fb-b220-c2a327ad5bf5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:13.798658 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394cc7d-d26a-4ca7-851b-6c799d8f9f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:13.799271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cc7d-d26a-4ca7-851b-6c799d8f9f89 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:13.799597 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cc7d-d26a-4ca7-851b-6c799d8f9f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:13.799867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cc7d-d26a-4ca7-851b-6c799d8f9f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:13.868435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394cc7d-d26a-4ca7-851b-6c799d8f9f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:13.869887 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394cc7d-d26a-4ca7-851b-6c799d8f9f89 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:13.879414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1345/2717] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:23.380350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:23.875060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=75 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:25.150250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:25.236916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa986d47-1a15-4fda-871b-3072467e78e0 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:25.242930 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:25.243770 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:25.244148 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:25.244540 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] PATH_INFO: `/v3/users/930d25db389444d7a78fcfad33cb6323` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:25.246034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=930d25db389444d7a78fcfad33cb6323)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:25.248195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:25.449483 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930d25db389444d7a78fcfad33cb6323'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:25.462214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930d25db389444d7a78fcfad33cb6323'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:25.463172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930d25db389444d7a78fcfad33cb6323'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:25.480357 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930d25db389444d7a78fcfad33cb6323'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:25.560549 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930d25db389444d7a78fcfad33cb6323'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:25.570133 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1373/2718] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:25 2022] DELETE /identity/v3/users/930d25db389444d7a78fcfad33cb6323 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:25.575186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:25.580165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:25.580165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:25.601877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:25.603712 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:25.695688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1346/2719] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:25.711163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:25.713006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:25.786779 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38faa4-fca4-4b91-88cf-c694f884ee3a admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:25.791171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:25.792094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:25.792525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:25.792963 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:25.805654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:25.807466 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:25.820241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1374/2720] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:26.379254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:26.383034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:26.412762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b96f5-2f61-427c-80c6-884dda5905e5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:26.437116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:26.437777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:26.438047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:26.438341 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] PATH_INFO: `/v3/projects/ce525e8a1b8843488f5083b0e3994fac` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:26.439539 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce525e8a1b8843488f5083b0e3994fac)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:26.442431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:26.574143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce525e8a1b8843488f5083b0e3994fac', 'request_id': 'req-dd824e32-1174-4652-ab61-4a9e78cc6e48'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:26.580082 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce525e8a1b8843488f5083b0e3994fac', 'request_id': 'req-dd824e32-1174-4652-ab61-4a9e78cc6e48'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:26.656013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce525e8a1b8843488f5083b0e3994fac', 'request_id': 'req-dd824e32-1174-4652-ab61-4a9e78cc6e48'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:26.679903 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] The token cache is being invalidate because project ce525e8a1b8843488f5083b0e3994fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:26.680575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:26.681733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:26.684482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1347/2721] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:26 2022] DELETE /identity/v3/projects/ce525e8a1b8843488f5083b0e3994fac => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:26.691147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:26.706569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ab8fc-6ec3-4d31-bc5a-8ab7793355b6 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:26.739863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:26.801179 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:26.802375 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:26.802877 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:26.803406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] PATH_INFO: `/v3/users/8336301466bb4ec5babc2a1b85da9d47` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:26.805459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8336301466bb4ec5babc2a1b85da9d47)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:26.807917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:27.018824 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8336301466bb4ec5babc2a1b85da9d47'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:27.031185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8336301466bb4ec5babc2a1b85da9d47'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:27.032000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8336301466bb4ec5babc2a1b85da9d47'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:27.052122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8336301466bb4ec5babc2a1b85da9d47'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:27.114371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-d7a1ceb0-9911-4560-ae7b-95402dbcc58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8336301466bb4ec5babc2a1b85da9d47'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:27.122444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1375/2722] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:26 2022] DELETE /identity/v3/users/8336301466bb4ec5babc2a1b85da9d47 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:27.733735 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:27.737105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:27.762965 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824e32-1174-4652-ab61-4a9e78cc6e48 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:27.869908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:27.871019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:27.871550 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:27.872036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] PATH_INFO: `/v3/projects/e310db7cb4be40e791e0dbd05b706489` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:27.874080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e310db7cb4be40e791e0dbd05b706489)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:27.877946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.002440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:28.028323 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e310db7cb4be40e791e0dbd05b706489', 'request_id': 'req-90e0a2cd-76ec-43af-acff-f84d1c5e7200'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:28.037075 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e310db7cb4be40e791e0dbd05b706489', 'request_id': 'req-90e0a2cd-76ec-43af-acff-f84d1c5e7200'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:28.152369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e310db7cb4be40e791e0dbd05b706489', 'request_id': 'req-90e0a2cd-76ec-43af-acff-f84d1c5e7200'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:28.171814 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] The token cache is being invalidate because project e310db7cb4be40e791e0dbd05b706489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:28.172225 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:28.173035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-90e0a2cd-76ec-43af-acff-f84d1c5e7200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:28.175292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1348/2723] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:27 2022] DELETE /identity/v3/projects/e310db7cb4be40e791e0dbd05b706489 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:28.183491 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15c15-c955-4263-b511-46d7b36e2270 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.184074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15c15-c955-4263-b511-46d7b36e2270 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.184634 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15c15-c955-4263-b511-46d7b36e2270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.213979 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c7d15c15-c955-4263-b511-46d7b36e2270 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:28.221204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c7d15c15-c955-4263-b511-46d7b36e2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:28.313723 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1376/2724] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:28.323155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb066-c384-4a4f-9bec-e7f1af88457a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.323463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb066-c384-4a4f-9bec-e7f1af88457a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.323736 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb066-c384-4a4f-9bec-e7f1af88457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.344423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-174cb066-c384-4a4f-9bec-e7f1af88457a None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:28.345649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-174cb066-c384-4a4f-9bec-e7f1af88457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:28.355777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1349/2725] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:28.360606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d15c15-c955-4263-b511-46d7b36e2270 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.371418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d15c15-c955-4263-b511-46d7b36e2270 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.376528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.377253 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.377594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.377913 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.378676 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:28.379105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.380911 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.397940 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1377/2726] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:28.402501 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cb066-c384-4a4f-9bec-e7f1af88457a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.418811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cb066-c384-4a4f-9bec-e7f1af88457a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.424187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.424836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.425111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.425384 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.426015 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.427996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.519543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1350/2727] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:28.524229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.536082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93215d3-cfde-4d46-9a18-67ac946a40f3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.564465 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:28.596986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.597688 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.597988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.598479 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.599139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.602701 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.721761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1378/2728] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:28.726899 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.738736 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5aef-0cc0-4844-ab08-23bc3f525f37 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.744693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.745412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.745747 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.746064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.746803 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.748730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.761199 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1351/2729] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:05:28.765863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.777853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011e2fa-4cfb-43d0-b4a2-99b7047d8e09 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.784017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29687-6140-4bac-8b55-cfba06ba6034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.787213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29687-6140-4bac-8b55-cfba06ba6034 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.787213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29687-6140-4bac-8b55-cfba06ba6034 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.787213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29687-6140-4bac-8b55-cfba06ba6034 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.787213 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29687-6140-4bac-8b55-cfba06ba6034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.789197 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29687-6140-4bac-8b55-cfba06ba6034 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.802020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1379/2730] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:28.807741 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.822715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbf18f-3c94-4034-ad37-2c94b4ed01ee admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.828723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.829580 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.830035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.830369 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] PATH_INFO: `/v3/projects/6cd180f738a7451c8b480526ceb949a1/users/1f9bcd7b3e2545b09e85022a7a6a1abb/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.848362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd180f738a7451c8b480526ceb949a1, user_id=1f9bcd7b3e2545b09e85022a7a6a1abb, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.852105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.944256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1352/2731] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:28 2022] PUT /identity/v3/projects/6cd180f738a7451c8b480526ceb949a1/users/1f9bcd7b3e2545b09e85022a7a6a1abb/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:28.956534 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836b24-c8ad-4f41-8d7b-8f1e23880932 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.956857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836b24-c8ad-4f41-8d7b-8f1e23880932 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.957239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836b24-c8ad-4f41-8d7b-8f1e23880932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.997035 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a2836b24-c8ad-4f41-8d7b-8f1e23880932 None None] MFA Rules not processed for user `1f9bcd7b3e2545b09e85022a7a6a1abb`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:28.999096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a2836b24-c8ad-4f41-8d7b-8f1e23880932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.082122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1380/2732] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:29.087767 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.161375 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6366-13e3-4905-ab74-98ae81544c8d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.166690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.167393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.167629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.167900 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.173818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.173818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.279078 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1353/2733] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:29.280917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836b24-c8ad-4f41-8d7b-8f1e23880932 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.299154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836b24-c8ad-4f41-8d7b-8f1e23880932 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.379584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.380421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.380816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.381182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.382445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.384579 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.507989 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1381/2734] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.514036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.534013 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66076eb-7787-4498-9bd6-c012393ab59d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.543393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.544524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.545254 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.545744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.546971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.550698 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.565672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1354/2735] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:29.571059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.589403 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8db99f-75b2-48ce-a208-a280c5065b44 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.597228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.598425 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.598796 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.599283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] PATH_INFO: `/v3/projects/1c86b71e32334e0faa9aa221c1776f14/users/2e55d439ae284021a898b48cf8171f5b/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.628379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c86b71e32334e0faa9aa221c1776f14, user_id=2e55d439ae284021a898b48cf8171f5b, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.634754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.726932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1382/2736] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:29 2022] PUT /identity/v3/projects/1c86b71e32334e0faa9aa221c1776f14/users/2e55d439ae284021a898b48cf8171f5b/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:29.733069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.752431 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73fa9-25fe-443d-9be5-c4b51cf497ac admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.784610 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:29.833695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fe89d-4045-4609-80e6-54631a10aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.834545 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fe89d-4045-4609-80e6-54631a10aa45 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.834951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fe89d-4045-4609-80e6-54631a10aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.835917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fe89d-4045-4609-80e6-54631a10aa45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.836718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fe89d-4045-4609-80e6-54631a10aa45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.838551 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fe89d-4045-4609-80e6-54631a10aa45 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.859304 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1355/2737] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:29.864149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.870481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:29.879048 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff527-a78f-46e0-b153-d125ff0bbc7b admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.886791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.890670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.890670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.890670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] PATH_INFO: `/v3/projects/1c86b71e32334e0faa9aa221c1776f14/users/2e55d439ae284021a898b48cf8171f5b/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.892756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c86b71e32334e0faa9aa221c1776f14, user_id=2e55d439ae284021a898b48cf8171f5b, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.896619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.910094 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1383/2738] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:29 2022] PUT /identity/v3/projects/1c86b71e32334e0faa9aa221c1776f14/users/2e55d439ae284021a898b48cf8171f5b/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:29.921710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.922031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.922269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.953177 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] MFA Rules not processed for user `2e55d439ae284021a898b48cf8171f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.954400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:30.032137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1356/2739] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:30.044756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.046515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:30.107194 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3287bd3-e391-4a3d-bd13-21abba889224 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.112299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.112967 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.117097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.117097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.183064 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.184553 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.193786 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1384/2740] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:05:32.696589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.698098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:32.766123 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeedf0e-a9af-4ab3-aa90-ca3ba33942f4 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.769936 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f6594-c80e-49ab-8fe9-0e7c19b84457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.770557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f6594-c80e-49ab-8fe9-0e7c19b84457 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.770833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f6594-c80e-49ab-8fe9-0e7c19b84457 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.771110 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f6594-c80e-49ab-8fe9-0e7c19b84457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.773520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-eb3f6594-c80e-49ab-8fe9-0e7c19b84457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:32.840937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:32.844124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f6594-c80e-49ab-8fe9-0e7c19b84457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.845970 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f6594-c80e-49ab-8fe9-0e7c19b84457 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.858350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1357/2741] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:05:33.322228 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:33.333254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e044c5-8ea1-43b3-b018-4c1023df3c47 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:33.338345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:33.338608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.338892 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.339170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] PATH_INFO: `/v3/users/1f9bcd7b3e2545b09e85022a7a6a1abb` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.340345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9bcd7b3e2545b09e85022a7a6a1abb)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:33.342286 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:33.510201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9bcd7b3e2545b09e85022a7a6a1abb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:33.517335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9bcd7b3e2545b09e85022a7a6a1abb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:33.518107 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9bcd7b3e2545b09e85022a7a6a1abb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:33.530444 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9bcd7b3e2545b09e85022a7a6a1abb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:33.592221 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9bcd7b3e2545b09e85022a7a6a1abb'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:33.599233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1385/2742] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:33 2022] DELETE /identity/v3/users/1f9bcd7b3e2545b09e85022a7a6a1abb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:33.603718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.605569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.605569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.623812 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:33.627398 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:33.692670 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1358/2743] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:33.703352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:33.704867 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:33.724899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:33.778894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fc5a-5e67-4118-a9a3-ac93d1296ad9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:33.783141 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:33.784013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.784289 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.784561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.796780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:33.799401 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:33.814399 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1386/2744] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:34.348546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:34.348546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:34.365729 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256c53b-d351-4d0d-8227-2c2a8169b620 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:34.371608 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:34.372272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:34.372604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:34.372884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] PATH_INFO: `/v3/projects/6cd180f738a7451c8b480526ceb949a1` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:34.374121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd180f738a7451c8b480526ceb949a1)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:34.376122 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:34.500307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd180f738a7451c8b480526ceb949a1', 'request_id': 'req-99df7831-f486-4a0f-b67f-abd9a8c8f7af'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.512559 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd180f738a7451c8b480526ceb949a1', 'request_id': 'req-99df7831-f486-4a0f-b67f-abd9a8c8f7af'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.588719 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd180f738a7451c8b480526ceb949a1', 'request_id': 'req-99df7831-f486-4a0f-b67f-abd9a8c8f7af'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.603491 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] The token cache is being invalidate because project 6cd180f738a7451c8b480526ceb949a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:34.604424 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.605136 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.606988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1359/2745] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:34 2022] DELETE /identity/v3/projects/6cd180f738a7451c8b480526ceb949a1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:34.611884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:34.624510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebef4d6-06e5-4361-be26-5ee780da3548 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:34.692352 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:34.693178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:34.693480 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:34.693758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] PATH_INFO: `/v3/users/2e55d439ae284021a898b48cf8171f5b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:34.695025 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e55d439ae284021a898b48cf8171f5b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:34.697103 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:34.892645 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e55d439ae284021a898b48cf8171f5b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.904238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e55d439ae284021a898b48cf8171f5b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.905961 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e55d439ae284021a898b48cf8171f5b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:34.927528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e55d439ae284021a898b48cf8171f5b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.046240 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-b3a69eb5-95b0-459c-87da-dec7d6064aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e55d439ae284021a898b48cf8171f5b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.056396 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1387/2746] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:34 2022] DELETE /identity/v3/users/2e55d439ae284021a898b48cf8171f5b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:35.589047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:35.592118 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:35.616450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df7831-f486-4a0f-b67f-abd9a8c8f7af admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:35.690824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:35.691500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:35.691808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:35.692053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] PATH_INFO: `/v3/projects/1c86b71e32334e0faa9aa221c1776f14` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:35.693213 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c86b71e32334e0faa9aa221c1776f14)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:35.695836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:35.721941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:35.831459 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c86b71e32334e0faa9aa221c1776f14', 'request_id': 'req-0dd94a41-171d-4fcb-a338-02500496b870'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.833033 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c86b71e32334e0faa9aa221c1776f14', 'request_id': 'req-0dd94a41-171d-4fcb-a338-02500496b870'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.920884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c86b71e32334e0faa9aa221c1776f14', 'request_id': 'req-0dd94a41-171d-4fcb-a338-02500496b870'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.935822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] The token cache is being invalidate because project 1c86b71e32334e0faa9aa221c1776f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:35.936124 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.937037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-0dd94a41-171d-4fcb-a338-02500496b870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.938798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1360/2747] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:35 2022] DELETE /identity/v3/projects/1c86b71e32334e0faa9aa221c1776f14 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:35.945572 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d78251-0ff9-44d2-a027-e63d4e7447ac None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:35.946109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d78251-0ff9-44d2-a027-e63d4e7447ac None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:35.946109 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d78251-0ff9-44d2-a027-e63d4e7447ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:35.976248 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-e2d78251-0ff9-44d2-a027-e63d4e7447ac None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:35.978419 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e2d78251-0ff9-44d2-a027-e63d4e7447ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:36.020691 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:36.069898 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1388/2748] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:36.084777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e136ca-9820-4b6d-afdb-e19217308aa5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.084777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e136ca-9820-4b6d-afdb-e19217308aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.084777 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e136ca-9820-4b6d-afdb-e19217308aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.120224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-53e136ca-9820-4b6d-afdb-e19217308aa5 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:36.125528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-53e136ca-9820-4b6d-afdb-e19217308aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:36.131582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1361/2749] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:36.136043 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d78251-0ff9-44d2-a027-e63d4e7447ac None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.149033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d78251-0ff9-44d2-a027-e63d4e7447ac None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:36.155599 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:36.156502 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.156881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.160077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.160077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:36.160077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:36.160077 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:36.182473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1389/2750] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:05:36.184159 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e136ca-9820-4b6d-afdb-e19217308aa5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.195321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e136ca-9820-4b6d-afdb-e19217308aa5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:36.201024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:36.201711 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.201991 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.202404 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.203387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:36.206856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:36.316732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1362/2751] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:36 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:36.322172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.335527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac806f-1772-4029-b883-94481edf5fd9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:36.428658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:36.429231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.429801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.430116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.430959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:36.433233 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:36.539439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1390/2752] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:36 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:36.544870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.565717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79999d8-308d-4251-9f4d-502f30cbf35d admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:36.573471 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:36.575303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.575303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.575303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.575996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:36.577639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:36.593346 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1363/2753] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:36.599105 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.610690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278063-3b62-4af2-a2b8-83bab80679e1 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:36.616781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f1f0-4dab-42f0-ab40-5e0f292b9bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:36.617512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f1f0-4dab-42f0-ab40-5e0f292b9bfa admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.617825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f1f0-4dab-42f0-ab40-5e0f292b9bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.618212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f1f0-4dab-42f0-ab40-5e0f292b9bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.619116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f1f0-4dab-42f0-ab40-5e0f292b9bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:36.620975 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f1f0-4dab-42f0-ab40-5e0f292b9bfa admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:36.636935 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1391/2754] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:05:36.645531 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.657752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ee264-2381-4ddc-9b82-1042b4880d83 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:36.663835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:36.664512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.664780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.665440 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] PATH_INFO: `/v3/projects/c69d98b657e140eaac839e92dc9b990e/users/47c4faa1a8244370b025779812aedee8/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.685137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69d98b657e140eaac839e92dc9b990e, user_id=47c4faa1a8244370b025779812aedee8, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:36.687755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:36.770558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1364/2755] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:36 2022] PUT /identity/v3/projects/c69d98b657e140eaac839e92dc9b990e/users/47c4faa1a8244370b025779812aedee8/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:36.782871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.783295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.783805 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.829817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] MFA Rules not processed for user `47c4faa1a8244370b025779812aedee8`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:36.832928 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:36.956884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1392/2756] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:36.970414 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.972641 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:37.077883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165686-76ba-4c60-9547-d87a2aeda4c8 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:37.082472 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f59dfd806f4d1cada6a42f5fce3b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:37.089306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:37.089306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:37.089306 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:37.095948 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:37.097412 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:37.108646 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1365/2757] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:37.284452 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:37.286933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:37.373670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:37.416698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c815-d9dd-44ce-be5a-f18b926c7491 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:37.427060 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:37.427846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:37.428160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:37.428463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] PATH_INFO: `/v3/users/cf3712f97958438581b8e153723a1d71` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:37.444295 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3712f97958438581b8e153723a1d71)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:37.446421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:37.706916 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3712f97958438581b8e153723a1d71'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:37.715843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3712f97958438581b8e153723a1d71'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:37.716703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3712f97958438581b8e153723a1d71'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:37.730620 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3712f97958438581b8e153723a1d71'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:37.837484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-7f5e26be-fe92-4a04-b258-0be113a8b501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3712f97958438581b8e153723a1d71'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:37.844349 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1393/2758] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:37 2022] DELETE /identity/v3/users/cf3712f97958438581b8e153723a1d71 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:38.168023 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:38.186483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb9286-bca8-45a8-bfd8-fab6bfc50d97 service glance] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:38.220805 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:38.258782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:38.261187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:38.261187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:38.261187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] PATH_INFO: `/v3/projects/4600f776fb78446ab25a3ee913934fcc` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:38.273765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4600f776fb78446ab25a3ee913934fcc)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:38.276010 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:38.390500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4600f776fb78446ab25a3ee913934fcc', 'request_id': 'req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.397961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4600f776fb78446ab25a3ee913934fcc', 'request_id': 'req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.471819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4600f776fb78446ab25a3ee913934fcc', 'request_id': 'req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.485221 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] The token cache is being invalidate because project 4600f776fb78446ab25a3ee913934fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:38.485510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.486198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c42f49ef-0d0d-4178-b9af-4cbf9cda8b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.487738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1366/2759] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:38 2022] DELETE /identity/v3/projects/4600f776fb78446ab25a3ee913934fcc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:38.492802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9025-905f-43d2-8e32-8ab0a1405de2 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:38.493600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9025-905f-43d2-8e32-8ab0a1405de2 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:38.493600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9025-905f-43d2-8e32-8ab0a1405de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:38.513883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-967a9025-905f-43d2-8e32-8ab0a1405de2 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:38.515013 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-967a9025-905f-43d2-8e32-8ab0a1405de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:38.584382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1394/2760] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:38.595224 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6ca57-2e7f-4273-8412-214f6dfb42e3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:38.595856 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6ca57-2e7f-4273-8412-214f6dfb42e3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:38.596322 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6ca57-2e7f-4273-8412-214f6dfb42e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:38.620715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-38d6ca57-2e7f-4273-8412-214f6dfb42e3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:38.622761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-38d6ca57-2e7f-4273-8412-214f6dfb42e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:38.633201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1367/2761] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:38.637584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9025-905f-43d2-8e32-8ab0a1405de2 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:38.648717 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9025-905f-43d2-8e32-8ab0a1405de2 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:38.653608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:38.654237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:38.654516 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:38.654799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:38.655512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:38.656263 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:38.657515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:38.676020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1395/2762] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:38.677359 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6ca57-2e7f-4273-8412-214f6dfb42e3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:38.688248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6ca57-2e7f-4273-8412-214f6dfb42e3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:38.694914 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:38.695938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:38.697103 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:38.697397 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:38.698071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:38.700104 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:38.822095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1368/2763] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:38 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:38.828810 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:38.841825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580d6e4-a2c2-4cc6-b100-b65699add869 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:38.871019 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:38.904896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:38.905550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:38.905833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:38.906150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:38.906788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:38.908755 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:39.034857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1396/2764] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:38 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:39.039979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:39.050957 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93fc34-e19e-457c-b09c-50a8bcacc468 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:39.055740 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:39.056376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.056656 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.056930 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.057586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:39.059186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:39.070985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1369/2765] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:39.079707 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:39.091690 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0042ce-aa6b-4baa-aa09-cf4f43baf5a9 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:39.097641 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a740b0-3be7-408a-b2f3-07792e935b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:39.098270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a740b0-3be7-408a-b2f3-07792e935b00 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.098547 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a740b0-3be7-408a-b2f3-07792e935b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.098825 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a740b0-3be7-408a-b2f3-07792e935b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.099509 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a740b0-3be7-408a-b2f3-07792e935b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:39.101118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a740b0-3be7-408a-b2f3-07792e935b00 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:39.111938 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1397/2766] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:39.116041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:39.127051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce5ed-266e-44a6-839e-271398df2562 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:39.132401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:39.133160 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.133383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.133657 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] PATH_INFO: `/v3/projects/5d218206dcfd460a93035144c44ec2f6/users/48e346f5fa354c7cb5b83540c8b36531/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.154543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d218206dcfd460a93035144c44ec2f6, user_id=48e346f5fa354c7cb5b83540c8b36531, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:39.160036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:39.237684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1370/2767] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:39 2022] PUT /identity/v3/projects/5d218206dcfd460a93035144c44ec2f6/users/48e346f5fa354c7cb5b83540c8b36531/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:39.241071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8461-4ca1-433c-9853-1204f1439cad None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.241358 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8461-4ca1-433c-9853-1204f1439cad None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.241708 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8461-4ca1-433c-9853-1204f1439cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.262237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-4d4b8461-4ca1-433c-9853-1204f1439cad None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:39.263493 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-4d4b8461-4ca1-433c-9853-1204f1439cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:39.346525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1398/2768] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:39.359922 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:39.362653 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:39.418951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:39.424823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec192-68fc-4357-a11e-b029c4a33eda admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:39.432097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:39.432097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.432097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.432097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.439417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:39.440883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:39.453727 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1371/2769] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:05:45.510990 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a83fc-cbf6-4a38-b624-47049fd152c7 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.511591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a83fc-cbf6-4a38-b624-47049fd152c7 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.512130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a83fc-cbf6-4a38-b624-47049fd152c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.560896 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-8e1a83fc-cbf6-4a38-b624-47049fd152c7 None None] MFA Rules not processed for user `48e346f5fa354c7cb5b83540c8b36531`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:45.562262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8e1a83fc-cbf6-4a38-b624-47049fd152c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.661429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1399/2770] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:45.679985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:45.681811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.805764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecfe98-c002-401d-bb21-0340a101d55f service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:45.815737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:45.817112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.817112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.817112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.831601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:45.833230 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:45.844357 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1372/2771] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:49.073406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cc0d5-42ef-4c16-9b29-b9f6d229395f None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.074021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cc0d5-42ef-4c16-9b29-b9f6d229395f None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.074021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cc0d5-42ef-4c16-9b29-b9f6d229395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.096053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-d79cc0d5-42ef-4c16-9b29-b9f6d229395f None None] MFA Rules not processed for user `48e346f5fa354c7cb5b83540c8b36531`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:49.097301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-d79cc0d5-42ef-4c16-9b29-b9f6d229395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.105323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1400/2772] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:55.839532 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=39 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:59.090725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:25.275227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.276686 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.290541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7fcfc-2904-4d7a-8757-07c198d0efac service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.295566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.296198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.296480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.296754 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] PATH_INFO: `/v3/users/47c4faa1a8244370b025779812aedee8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.297894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c4faa1a8244370b025779812aedee8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.299836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.462774 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c4faa1a8244370b025779812aedee8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.463498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c4faa1a8244370b025779812aedee8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.470505 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c4faa1a8244370b025779812aedee8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.471158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c4faa1a8244370b025779812aedee8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.483179 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c4faa1a8244370b025779812aedee8'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.552070 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1373/2773] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:25 2022] DELETE /identity/v3/users/47c4faa1a8244370b025779812aedee8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:25.557073 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.557585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.557710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.577238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:25.578459 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.639695 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1401/2774] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:25.649867 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.651423 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.710520 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf88763-799a-48e7-aff7-8cb0e2201e64 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.714234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3149a-7a29-4c14-a6e6-d1fadd740e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.714862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3149a-7a29-4c14-a6e6-d1fadd740e8d service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.715141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3149a-7a29-4c14-a6e6-d1fadd740e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.715448 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3149a-7a29-4c14-a6e6-d1fadd740e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.724874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3149a-7a29-4c14-a6e6-d1fadd740e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.726299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3149a-7a29-4c14-a6e6-d1fadd740e8d service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.735870 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1374/2775] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:26.170791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:26.170791 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:26.193681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dc8a3-822d-45ab-9bd1-85de386ebf93 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:26.198973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:26.199654 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:26.199936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:26.200237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] PATH_INFO: `/v3/projects/c69d98b657e140eaac839e92dc9b990e` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:26.201354 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69d98b657e140eaac839e92dc9b990e)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:26.203274 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:26.319082 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69d98b657e140eaac839e92dc9b990e', 'request_id': 'req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:26.326598 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69d98b657e140eaac839e92dc9b990e', 'request_id': 'req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:26.451178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69d98b657e140eaac839e92dc9b990e', 'request_id': 'req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:26.469785 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] The token cache is being invalidate because project c69d98b657e140eaac839e92dc9b990e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:26.470195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:26.473172 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-fc5ed5aa-cb7f-49e2-8adb-2576339873b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:26.473920 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1402/2776] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:26 2022] DELETE /identity/v3/projects/c69d98b657e140eaac839e92dc9b990e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:26.479792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5cd9-56ac-4fcf-85d1-ccfdbaf87d07 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:26.480853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5cd9-56ac-4fcf-85d1-ccfdbaf87d07 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:26.480853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5cd9-56ac-4fcf-85d1-ccfdbaf87d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:26.502937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fdcb5cd9-56ac-4fcf-85d1-ccfdbaf87d07 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:26.504210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fdcb5cd9-56ac-4fcf-85d1-ccfdbaf87d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:26.572139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1375/2777] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:26.580817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dacdec-63a6-4d8a-b99f-9be9272d70b0 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:26.581410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dacdec-63a6-4d8a-b99f-9be9272d70b0 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:26.581410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dacdec-63a6-4d8a-b99f-9be9272d70b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:26.604028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-41dacdec-63a6-4d8a-b99f-9be9272d70b0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:26.605275 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-41dacdec-63a6-4d8a-b99f-9be9272d70b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:26.613806 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1403/2778] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:26.618206 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb5cd9-56ac-4fcf-85d1-ccfdbaf87d07 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:26.628025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb5cd9-56ac-4fcf-85d1-ccfdbaf87d07 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:26.633232 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:26.633909 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:26.634189 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:26.634482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:26.635138 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:26.635894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:26.637084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:26.649833 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1376/2779] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:26.654473 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dacdec-63a6-4d8a-b99f-9be9272d70b0 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:26.665238 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dacdec-63a6-4d8a-b99f-9be9272d70b0 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:26.669901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:26.670530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:26.670808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:26.671078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:26.671790 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:26.673817 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:26.797840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1404/2780] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:26 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:26.802055 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:26.807280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:26.812835 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072916f-c3f1-405e-90c1-02b45b085302 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:26.868432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:26.869024 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:26.869300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:26.869568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:26.870194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:26.872135 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.014507 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1377/2781] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:26 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:27.018745 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.030360 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f8319-20f7-48e0-8bce-d3e18d170dbb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.035037 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.040426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.040426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.040426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.040426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.040426 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.049488 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1405/2782] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:27.053721 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.064347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a69f8-189d-4d05-86ef-bc70875422a0 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.069655 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e062838-71d4-4734-b162-a8ec1c35aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.070281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e062838-71d4-4734-b162-a8ec1c35aeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.070558 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e062838-71d4-4734-b162-a8ec1c35aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.070827 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e062838-71d4-4734-b162-a8ec1c35aeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.071508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e062838-71d4-4734-b162-a8ec1c35aeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.073113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e062838-71d4-4734-b162-a8ec1c35aeb1 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.084439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1378/2783] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:27.089418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.099764 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17cbd-066c-42b6-bb0b-828d9ceae538 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.104357 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.105007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.105283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.105552 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] PATH_INFO: `/v3/projects/ff08af38e1ad4f20abd69335871f313a/users/a1149c7b88df4f94942b1d11557c6511/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.122412 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff08af38e1ad4f20abd69335871f313a, user_id=a1149c7b88df4f94942b1d11557c6511, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.125255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.208449 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1406/2784] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:27 2022] PUT /identity/v3/projects/ff08af38e1ad4f20abd69335871f313a/users/a1149c7b88df4f94942b1d11557c6511/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:27.213761 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b84aa-881c-4ebf-9914-0449791a7910 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.214046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b84aa-881c-4ebf-9914-0449791a7910 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.214318 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b84aa-881c-4ebf-9914-0449791a7910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.233248 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-5e1b84aa-881c-4ebf-9914-0449791a7910 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:27.235227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5e1b84aa-881c-4ebf-9914-0449791a7910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:27.293527 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1379/2785] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:27.302788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.305008 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:27.327458 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:27.365283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d8dd-635a-4fd1-9d7c-21b1bd81c38c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.369986 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.370623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.370899 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.371168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.380973 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.383067 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.393640 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1407/2786] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:28.864299 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f86c6-356e-40bf-aef5-36cf09f3c0ba None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.864915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f86c6-356e-40bf-aef5-36cf09f3c0ba None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.864915 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f86c6-356e-40bf-aef5-36cf09f3c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.901101 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-db3f86c6-356e-40bf-aef5-36cf09f3c0ba None None] MFA Rules not processed for user `a1149c7b88df4f94942b1d11557c6511`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:28.902525 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-db3f86c6-356e-40bf-aef5-36cf09f3c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:28.980780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1380/2787] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:28.992281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:28.993714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:29.052015 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6cf5c-6614-43e6-a033-8fb580c29895 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:29.056251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:29.056845 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:29.057130 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:29.057402 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:29.066090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:29.067561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:29.076559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1408/2788] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:30.839588 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:30.840195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:30.840195 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:30.861175 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] MFA Rules not processed for user `a1149c7b88df4f94942b1d11557c6511`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:30.862406 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:30.869984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1381/2789] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:31.113844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:31.115431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:31.128183 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c2ae-5563-4d94-9f2e-c46c42aaa6fc service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:31.132308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79659b1-e40f-4fe4-b7a2-70c9c7bcb5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:31.132908 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79659b1-e40f-4fe4-b7a2-70c9c7bcb5aa service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.133187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79659b1-e40f-4fe4-b7a2-70c9c7bcb5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.133461 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79659b1-e40f-4fe4-b7a2-70c9c7bcb5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.135199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c79659b1-e40f-4fe4-b7a2-70c9c7bcb5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:31.145153 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79659b1-e40f-4fe4-b7a2-70c9c7bcb5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:31.146593 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79659b1-e40f-4fe4-b7a2-70c9c7bcb5aa service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:31.154678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1409/2790] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:33.039286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:33.040738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:33.046983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:33.111087 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ed04e-fd07-4b5b-a56b-92bc69443902 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:33.116619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab8825-609d-461d-a1d6-116fddee1826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:33.117219 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8825-609d-461d-a1d6-116fddee1826 service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:33.117492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8825-609d-461d-a1d6-116fddee1826 service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:33.117755 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8825-609d-461d-a1d6-116fddee1826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:33.119487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e9ab8825-609d-461d-a1d6-116fddee1826 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:33.132949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab8825-609d-461d-a1d6-116fddee1826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:33.134548 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab8825-609d-461d-a1d6-116fddee1826 service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:33.145137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1382/2791] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:41.151154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=49 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:43.140633 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=30 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:55.295254 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872c5f-cfd2-4cac-bbc1-f84e3c0f1654 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:55.295884 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872c5f-cfd2-4cac-bbc1-f84e3c0f1654 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:55.295982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872c5f-cfd2-4cac-bbc1-f84e3c0f1654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:55.316345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-9d872c5f-cfd2-4cac-bbc1-f84e3c0f1654 None None] MFA Rules not processed for user `a1149c7b88df4f94942b1d11557c6511`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:55.317602 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-9d872c5f-cfd2-4cac-bbc1-f84e3c0f1654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:55.324997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1410/2792] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:58.128210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9d69-6957-457b-8b67-72bda411cfc7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:58.128768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9d69-6957-457b-8b67-72bda411cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:58.128768 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9d69-6957-457b-8b67-72bda411cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:58.148921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-84ed9d69-6957-457b-8b67-72bda411cfc7 None None] MFA Rules not processed for user `e9c8beca893f40f08befa76dd712285f`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:58.150127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-84ed9d69-6957-457b-8b67-72bda411cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:58.204485 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1383/2793] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:05.310323 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:07.739988 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d872c5f-cfd2-4cac-bbc1-f84e3c0f1654 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:07.750338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d872c5f-cfd2-4cac-bbc1-f84e3c0f1654 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:07.753657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:07.754268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:07.755218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:07.755519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:07.757389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:07.833566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:07.835021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:07.846907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1411/2794] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:08.197709 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=25 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:16.079088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed9d69-6957-457b-8b67-72bda411cfc7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:16.089326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed9d69-6957-457b-8b67-72bda411cfc7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:16.093334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:16.093982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:16.094264 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:16.094541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:16.096349 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:16.110848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:16.112321 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:16.124127 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1384/2795] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:17.841543 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=34 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:24.636978 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:24.638566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:24.654024 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827630c1-7f40-4b90-b212-15885ea6179e service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:24.660074 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:24.660804 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:24.661160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:24.661508 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:24.664484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:24.678380 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:24.680038 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:24.693056 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1412/2796] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:08:26.119083 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:34.687201 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:12.651642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:12.663205 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7420a6-7f06-4b7b-852a-939755ce2f75 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:12.668252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:12.668853 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:12.669128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:12.669401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:12.671169 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:12.683061 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:12.684688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:12.695433 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1385/2797] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:09:12.777651 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:12.793044 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6c86f-a00d-4710-b0bc-caa7e4469aa2 service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:12.800040 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:12.801039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:12.801395 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:12.801713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] PATH_INFO: `/v3/users/a1149c7b88df4f94942b1d11557c6511` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:12.803569 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1149c7b88df4f94942b1d11557c6511)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:12.806076 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:12.983907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1149c7b88df4f94942b1d11557c6511'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:12.991603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1149c7b88df4f94942b1d11557c6511'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:12.992326 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1149c7b88df4f94942b1d11557c6511'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.004339 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1149c7b88df4f94942b1d11557c6511'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.072581 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1149c7b88df4f94942b1d11557c6511'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.079145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1413/2798] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:09:12 2022] DELETE /identity/v3/users/a1149c7b88df4f94942b1d11557c6511 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:09:13.355574 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:13.367050 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9255d3-95d3-427b-b79e-52c2cc6969d9 service placement] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:13.438112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:13.438749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:13.439034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:13.439307 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] PATH_INFO: `/v3/projects/ff08af38e1ad4f20abd69335871f313a` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:13.440546 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff08af38e1ad4f20abd69335871f313a)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:13.442508 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:13.548732 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff08af38e1ad4f20abd69335871f313a', 'request_id': 'req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.554350 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff08af38e1ad4f20abd69335871f313a', 'request_id': 'req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.631951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff08af38e1ad4f20abd69335871f313a', 'request_id': 'req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.643986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] The token cache is being invalidate because project ff08af38e1ad4f20abd69335871f313a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:09:13.644282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.644927 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:13.647045 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1386/2799] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:09:13 2022] DELETE /identity/v3/projects/ff08af38e1ad4f20abd69335871f313a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:09:23.075302 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:23.640884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:29.235165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:29.236619 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:29.293338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ecfaa-ce81-4301-8996-62afc80f8b07 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:29.340192 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e0d5d-ceb9-4609-850b-271ddf009c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:29.340800 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0d5d-ceb9-4609-850b-271ddf009c4f service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:29.341108 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0d5d-ceb9-4609-850b-271ddf009c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:29.341382 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0d5d-ceb9-4609-850b-271ddf009c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:29.343171 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-042e0d5d-ceb9-4609-850b-271ddf009c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:29.353199 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e0d5d-ceb9-4609-850b-271ddf009c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:29.354646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e0d5d-ceb9-4609-850b-271ddf009c4f service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:29.363476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1414/2800] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:09:39.359788 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=46 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:26.894394 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:26.903092 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:26.953906 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60483-4da1-42e0-bd3b-a7cd64f9dcf0 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:26.957738 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:26.958453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:26.958737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:26.959012 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:26.960813 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:27.018642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:27.020109 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:27.029519 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1387/2801] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:37.024932 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=48 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:38.490976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:38.491541 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:38.491657 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:38.511069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] MFA Rules not processed for user `e9c8beca893f40f08befa76dd712285f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:38.512332 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:38.519816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1415/2802] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:38.833051 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:38.834518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:38.846209 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47270519-1458-4fcd-b94f-9f29c13f2693 service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:38.849825 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:38.850413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:38.850692 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:38.850988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:38.852672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:38.862035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:38.863512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:38.871415 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1388/2803] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:39.547789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:39.549255 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:39.627851 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f819-11a8-4128-a227-010ae3d6cb47 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:39.630420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:39.631020 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:39.631298 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:39.631623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:39.633455 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:39.646460 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:39.648145 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:39.658861 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1416/2804] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:43.023148 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:43.024647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:43.104552 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c633c-a30d-40ea-a87d-69f00e97501c service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:43.112606 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:43.113493 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:43.113920 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:43.114317 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:43.116816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:43.135039 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:43.136770 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:43.148604 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1389/2805] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:49.654756 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=35 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:53.143818 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=40 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:55.300592 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:55.302163 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:55.318127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9292039-179b-42b2-b7fe-70b64622f395 service placement] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:55.323623 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b9a470bced4efcaef3ed849f6963fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:55.324225 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:55.324506 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:55.324778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:55.327284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:55.339709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:55.341223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:55.352753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1417/2806] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:58.458797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:58.460330 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:58.472331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837207a0-55ad-4e32-bca0-7ba7468c73d3 service nova] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:58.476057 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e8b08-8cae-4589-9f8f-6b6ff5b5482a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:58.486017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e8b08-8cae-4589-9f8f-6b6ff5b5482a service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:58.486017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e8b08-8cae-4589-9f8f-6b6ff5b5482a service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:58.486017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e8b08-8cae-4589-9f8f-6b6ff5b5482a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:58.486017 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-480e8b08-8cae-4589-9f8f-6b6ff5b5482a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:58.542583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e8b08-8cae-4589-9f8f-6b6ff5b5482a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:58.544063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e8b08-8cae-4589-9f8f-6b6ff5b5482a service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:58.553860 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1390/2807] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:05.348550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:05.364901 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:05.375482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32121-7f2d-4f16-b1b7-3980d508594a service nova] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:05.379499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:05.380114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:05.380397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:05.380673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:05.382498 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:05.444799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:05.446284 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:05.456894 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1418/2808] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:08.549468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=30 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:13.730034 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654573-a7f1-42b8-8b4e-eff8c48e9831 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:13.730766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654573-a7f1-42b8-8b4e-eff8c48e9831 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:13.730766 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654573-a7f1-42b8-8b4e-eff8c48e9831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:13.760913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-73654573-a7f1-42b8-8b4e-eff8c48e9831 None None] MFA Rules not processed for user `48e346f5fa354c7cb5b83540c8b36531`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:13.762141 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-73654573-a7f1-42b8-8b4e-eff8c48e9831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:13.786605 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1391/2809] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:15.451743 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=28 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:23.784476 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=15 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:30.102551 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:30.162873 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c5070-4e72-41a6-8023-409eaee52edc service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:30.168397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:30.169004 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:30.169290 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:30.169558 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:30.171322 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:30.196816 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:30.198454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:30.209135 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1419/2810] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:40.204364 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=32 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:07.727272 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654573-a7f1-42b8-8b4e-eff8c48e9831 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:07.753469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654573-a7f1-42b8-8b4e-eff8c48e9831 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:07.759387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:07.760338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:07.760730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:07.761151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:07.764133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:07.809392 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:07.812836 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:07.841850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1392/2811] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:17.256870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:17.272071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403856-1179-4abe-8e11-c50c34542dff service placement] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:17.276905 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:17.277514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:17.277802 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:17.278283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:17.280170 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:17.301530 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:17.303270 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:17.315766 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1420/2812] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:17.838973 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=22 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:22.133726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:22.144811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a777-11ac-42ed-b5a5-a21b7a17bc70 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:22.148842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:22.149445 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:22.149728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:22.150008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:22.152305 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:22.247690 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:22.249156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:22.273008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1393/2813] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:22.282242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:22.293325 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452675e7-e893-41c8-8515-a4f8aacb7724 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:22.298059 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:22.298703 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:22.299116 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:22.299555 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:22.301783 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:22.315698 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:22.317813 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:22.330212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1421/2814] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:26.992510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:27.004639 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435315f-5721-43ce-86bd-10e21f3b6656 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:27.010126 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:27.010749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:27.011029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:27.011326 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:27.013417 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:27.027222 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:27.029119 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:27.040650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1394/2815] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:27.150448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:27.153223 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:27.167947 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546144b4-746e-470f-96ef-a7104f9b7417 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:27.172880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:27.173591 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:27.173951 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:27.174309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] PATH_INFO: `/v3/users/48e346f5fa354c7cb5b83540c8b36531` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:27.175612 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e346f5fa354c7cb5b83540c8b36531)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:27.177917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:27.407980 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e346f5fa354c7cb5b83540c8b36531'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:27.416447 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e346f5fa354c7cb5b83540c8b36531'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:27.418528 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e346f5fa354c7cb5b83540c8b36531'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:27.437212 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e346f5fa354c7cb5b83540c8b36531'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:27.501187 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f7314943-a29a-4652-95b7-abd28e37a450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e346f5fa354c7cb5b83540c8b36531'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:27.508709 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1422/2816] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:27 2022] DELETE /identity/v3/users/48e346f5fa354c7cb5b83540c8b36531 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:27.875080 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:27.893194 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfb82-a679-4cb3-83e2-d1b025b28954 service placement] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:27.984463 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:27.985037 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:27.985300 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:27.985883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] PATH_INFO: `/v3/projects/5d218206dcfd460a93035144c44ec2f6` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:27.987168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d218206dcfd460a93035144c44ec2f6)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:27.992468 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:28.117578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d218206dcfd460a93035144c44ec2f6', 'request_id': 'req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:28.121500 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:28.123864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d218206dcfd460a93035144c44ec2f6', 'request_id': 'req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:28.210352 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d218206dcfd460a93035144c44ec2f6', 'request_id': 'req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:28.230303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] The token cache is being invalidate because project 5d218206dcfd460a93035144c44ec2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:28.230772 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:28.231807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8d3449d0-f08f-42f4-b2d3-ef0a48e7cb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:28.234816 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1395/2817] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:27 2022] DELETE /identity/v3/projects/5d218206dcfd460a93035144c44ec2f6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:28.241272 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644ca8-e1dc-44f2-be5b-b6e259cf8de9 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:28.242250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644ca8-e1dc-44f2-be5b-b6e259cf8de9 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:28.242250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644ca8-e1dc-44f2-be5b-b6e259cf8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:28.331594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-c8644ca8-e1dc-44f2-be5b-b6e259cf8de9 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:28.333097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c8644ca8-e1dc-44f2-be5b-b6e259cf8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:28.429149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1423/2818] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:28.437286 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd588384-fa33-47f7-baca-40dc4351bef0 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:28.437569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd588384-fa33-47f7-baca-40dc4351bef0 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:28.437843 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd588384-fa33-47f7-baca-40dc4351bef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:28.461782 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fd588384-fa33-47f7-baca-40dc4351bef0 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:28.463060 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fd588384-fa33-47f7-baca-40dc4351bef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:28.471962 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1396/2819] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:28.478897 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8644ca8-e1dc-44f2-be5b-b6e259cf8de9 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:28.493112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8644ca8-e1dc-44f2-be5b-b6e259cf8de9 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:28.499297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:28.500224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:28.500616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:28.501009 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:28.501915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:28.502374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:28.505208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:28.521514 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1424/2820] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:28.528848 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd588384-fa33-47f7-baca-40dc4351bef0 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:28.546063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd588384-fa33-47f7-baca-40dc4351bef0 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:28.553795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:28.554806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:28.555283 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:28.555859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:28.556937 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:28.560541 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:28.673656 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1397/2821] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:28 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:28.680862 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:28.687512 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:28.695096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71076b-f00d-4644-b3a7-48f306dad4a2 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:28.807529 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:28.808811 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:28.809377 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:28.809952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:28.811186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:28.815178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:28.921955 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1425/2822] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:28 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:28.925831 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:28.937073 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5485-8096-45b7-9fba-6b0b3ae30427 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:28.942237 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:28.942929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:28.943338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:28.943699 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:28.944421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:28.946107 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:28.965642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1398/2823] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:28.967330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:28.982638 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5bf1-ab37-4367-9b3f-95c51ef646bf admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:28.991943 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fbb4e-d1ca-400b-be2f-545f2f6df2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:28.995724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fbb4e-d1ca-400b-be2f-545f2f6df2cd admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:28.995724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fbb4e-d1ca-400b-be2f-545f2f6df2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:28.995724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fbb4e-d1ca-400b-be2f-545f2f6df2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:28.995724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fbb4e-d1ca-400b-be2f-545f2f6df2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:28.995724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fbb4e-d1ca-400b-be2f-545f2f6df2cd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:29.007575 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1426/2824] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:29.011749 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:29.023461 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78651a-4195-4cee-8e3a-82d688e3b2ef admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:29.031457 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:29.032146 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:29.032473 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:29.032862 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] PATH_INFO: `/v3/projects/eb6ba019dd694feba9af541190c71b9a/users/143b561e54f64e21b05ff00bf109a12d/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:29.055064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6ba019dd694feba9af541190c71b9a, user_id=143b561e54f64e21b05ff00bf109a12d, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:29.057832 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:29.160327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6778c-ea8d-434f-bc30-3574ed74a052 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:29.160784 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6778c-ea8d-434f-bc30-3574ed74a052 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:29.161166 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6778c-ea8d-434f-bc30-3574ed74a052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:29.164035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1399/2825] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:29 2022] PUT /identity/v3/projects/eb6ba019dd694feba9af541190c71b9a/users/143b561e54f64e21b05ff00bf109a12d/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:29.216400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-61a6778c-ea8d-434f-bc30-3574ed74a052 None None] MFA Rules not processed for user `143b561e54f64e21b05ff00bf109a12d`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:29.218390 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-61a6778c-ea8d-434f-bc30-3574ed74a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:29.298143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1427/2826] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:29.303178 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:29.377155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b3155-1233-4428-936b-9b970b40b271 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:29.386535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:29.387267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:29.387578 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:29.387863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:29.388512 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:29.391967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:29.498227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1400/2827] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:29 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:29.501953 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6778c-ea8d-434f-bc30-3574ed74a052 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:29.516902 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6778c-ea8d-434f-bc30-3574ed74a052 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:29.600521 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:29.601162 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:29.601445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:29.601719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:29.602778 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:29.604870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:29.733762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:29.742190 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1428/2828] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:29 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:29.744112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:29.760366 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb656a91-dc07-4bc5-a501-752568d94e0c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:29.766489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:29.767162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:29.767425 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:29.767702 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:29.768363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:29.770048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:29.783941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1401/2829] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:29.790110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:29.802706 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8893-bc8e-45c4-86c4-54cc58b3925f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:29.807563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:29.808237 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:29.808519 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:29.808795 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] PATH_INFO: `/v3/projects/ae4ad1a5baae4f9d9f26d19adbd6cd6a/users/fafc197def654e9c9afc1f7042c8428a/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:29.829063 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4ad1a5baae4f9d9f26d19adbd6cd6a, user_id=fafc197def654e9c9afc1f7042c8428a, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:29.834732 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:29.946724 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1429/2830] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:29 2022] PUT /identity/v3/projects/ae4ad1a5baae4f9d9f26d19adbd6cd6a/users/fafc197def654e9c9afc1f7042c8428a/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:29.950650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:29.962256 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428d4c-9b02-499a-aca5-14c9e5006dca admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:30.018554 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:30.028674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f64c4-c4a4-4b0f-bba4-0c93ff8628dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:30.029428 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f64c4-c4a4-4b0f-bba4-0c93ff8628dd admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:30.029710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f64c4-c4a4-4b0f-bba4-0c93ff8628dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:30.030044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f64c4-c4a4-4b0f-bba4-0c93ff8628dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:30.030630 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f64c4-c4a4-4b0f-bba4-0c93ff8628dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:30.032282 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f64c4-c4a4-4b0f-bba4-0c93ff8628dd admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:30.045929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1402/2831] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:30.053852 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:30.068374 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e414dd-6c3e-4467-90e7-1baa5aa4e378 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:30.074373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:30.075097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:30.075697 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:30.078486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] PATH_INFO: `/v3/projects/ae4ad1a5baae4f9d9f26d19adbd6cd6a/users/fafc197def654e9c9afc1f7042c8428a/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:30.078486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4ad1a5baae4f9d9f26d19adbd6cd6a, user_id=fafc197def654e9c9afc1f7042c8428a, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:30.080933 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:30.098678 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1430/2832] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:30 2022] PUT /identity/v3/projects/ae4ad1a5baae4f9d9f26d19adbd6cd6a/users/fafc197def654e9c9afc1f7042c8428a/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:30.110365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e106-2454-45ae-b1af-e4c0744c8e2c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:30.110674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e106-2454-45ae-b1af-e4c0744c8e2c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:30.110986 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e106-2454-45ae-b1af-e4c0744c8e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:30.150043 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-ca81e106-2454-45ae-b1af-e4c0744c8e2c None None] MFA Rules not processed for user `fafc197def654e9c9afc1f7042c8428a`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:30.152966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-ca81e106-2454-45ae-b1af-e4c0744c8e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:30.259575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1403/2833] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:30.271658 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:30.275959 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:30.400846 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed9114-fd48-4de8-8534-47d64c32cfa4 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:30.409565 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910bc6d-8dad-41e4-9e49-4664b84fbb05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:30.411180 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910bc6d-8dad-41e4-9e49-4664b84fbb05 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:30.411776 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910bc6d-8dad-41e4-9e49-4664b84fbb05 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:30.412257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910bc6d-8dad-41e4-9e49-4664b84fbb05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:30.429168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910bc6d-8dad-41e4-9e49-4664b84fbb05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:30.430513 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910bc6d-8dad-41e4-9e49-4664b84fbb05 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:30.445576 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1431/2834] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:30.494139 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e106-2454-45ae-b1af-e4c0744c8e2c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:30.583663 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e106-2454-45ae-b1af-e4c0744c8e2c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:30.589281 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:30.589931 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:30.590207 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:30.590482 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] PATH_INFO: `/v3/users/143b561e54f64e21b05ff00bf109a12d` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:30.591677 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143b561e54f64e21b05ff00bf109a12d)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:30.594025 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:30.781008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143b561e54f64e21b05ff00bf109a12d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:30.781723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143b561e54f64e21b05ff00bf109a12d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:30.792001 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143b561e54f64e21b05ff00bf109a12d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:30.792961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143b561e54f64e21b05ff00bf109a12d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:30.812492 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143b561e54f64e21b05ff00bf109a12d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:30.817935 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:30.940462 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1404/2835] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:30 2022] DELETE /identity/v3/users/143b561e54f64e21b05ff00bf109a12d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:30.945159 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:30.945451 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:30.945759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:30.967330 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:30.968604 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:31.047689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1432/2836] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:31.057029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:31.060363 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:31.061120 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:31.063276 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:31.088718 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f93d-cbf4-493c-9626-35dd338a97c9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:31.096808 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:31.097726 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:31.098111 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:31.098422 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] PATH_INFO: `/v3/users/e9c8beca893f40f08befa76dd712285f` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:31.100331 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c8beca893f40f08befa76dd712285f)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:31.103009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:31.134870 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:31.160997 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec99c6-9846-4735-b624-65f2f80be22e None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:31.168373 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:31.169016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:31.169299 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:31.169566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:31.179763 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:31.181218 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:31.192096 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1433/2837] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:31.339035 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c8beca893f40f08befa76dd712285f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.339964 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c8beca893f40f08befa76dd712285f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.351693 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c8beca893f40f08befa76dd712285f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.352566 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c8beca893f40f08befa76dd712285f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.365085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c8beca893f40f08befa76dd712285f'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.448036 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1405/2838] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:31 2022] DELETE /identity/v3/users/e9c8beca893f40f08befa76dd712285f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:31.692936 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:31.694587 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:31.709125 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad89286-0548-4f59-9b03-6ad71df0a0c0 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:31.736540 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:31.739894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:31.790182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:31.790864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:31.791139 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:31.791470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] PATH_INFO: `/v3/projects/eb6ba019dd694feba9af541190c71b9a` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:31.792999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6ba019dd694feba9af541190c71b9a)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:31.795497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:31.832921 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226b98-14db-46e1-9a56-906376fa2e0e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:31.840227 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:31.841569 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:31.841990 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:31.848840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] PATH_INFO: `/v3/projects/4f044aa368374bfdbbe67eef66b02b28` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:31.848840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f044aa368374bfdbbe67eef66b02b28)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:31.848840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:31.917287 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6ba019dd694feba9af541190c71b9a', 'request_id': 'req-f797312c-de8a-4862-9c56-cc327c32ca0d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.924537 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6ba019dd694feba9af541190c71b9a', 'request_id': 'req-f797312c-de8a-4862-9c56-cc327c32ca0d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.981571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6ba019dd694feba9af541190c71b9a', 'request_id': 'req-f797312c-de8a-4862-9c56-cc327c32ca0d'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.986780 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f044aa368374bfdbbe67eef66b02b28', 'request_id': 'req-18438be9-45dc-4bd2-a6d6-49ee5f685f37'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.994526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f044aa368374bfdbbe67eef66b02b28', 'request_id': 'req-18438be9-45dc-4bd2-a6d6-49ee5f685f37'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.995912 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] The token cache is being invalidate because project eb6ba019dd694feba9af541190c71b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:31.996214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.996885 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:31.998414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1434/2839] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:31 2022] DELETE /identity/v3/projects/eb6ba019dd694feba9af541190c71b9a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:32.002627 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:32.004655 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:32.067203 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f044aa368374bfdbbe67eef66b02b28', 'request_id': 'req-18438be9-45dc-4bd2-a6d6-49ee5f685f37'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.069625 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:32.071630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797312c-de8a-4862-9c56-cc327c32ca0d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:32.080290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] The token cache is being invalidate because project 4f044aa368374bfdbbe67eef66b02b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:32.080582 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.081236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.082966 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1406/2840] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:31 2022] DELETE /identity/v3/projects/4f044aa368374bfdbbe67eef66b02b28 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:32.086811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:32.088419 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:32.089021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:32.137653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:32.138301 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:32.138600 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:32.138860 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] PATH_INFO: `/v3/users/fafc197def654e9c9afc1f7042c8428a` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:32.140112 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafc197def654e9c9afc1f7042c8428a)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:32.142123 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:32.158158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18438be9-45dc-4bd2-a6d6-49ee5f685f37 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:32.163979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:32.164884 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:32.165165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:32.165439 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] PATH_INFO: `/v3/users/6cf4cf25df9a41a791dd4923e2812479` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:32.166609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf4cf25df9a41a791dd4923e2812479)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:32.168666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:32.369515 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafc197def654e9c9afc1f7042c8428a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.376938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf4cf25df9a41a791dd4923e2812479'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.377863 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafc197def654e9c9afc1f7042c8428a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.378435 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf4cf25df9a41a791dd4923e2812479'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.379492 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafc197def654e9c9afc1f7042c8428a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.387622 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf4cf25df9a41a791dd4923e2812479'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.388372 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf4cf25df9a41a791dd4923e2812479'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.400309 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafc197def654e9c9afc1f7042c8428a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.402627 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf4cf25df9a41a791dd4923e2812479'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.505331 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafc197def654e9c9afc1f7042c8428a'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:32.512942 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1435/2841] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:32 2022] DELETE /identity/v3/users/fafc197def654e9c9afc1f7042c8428a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:32.588163 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1407/2842] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:32 2022] DELETE /identity/v3/users/6cf4cf25df9a41a791dd4923e2812479 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:32.975759 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:32.977250 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:33.051470 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f5ea-43a2-49cf-8713-836cd1b4f3b7 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:33.095595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:33.112527 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:33.113216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.113501 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.113777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] PATH_INFO: `/v3/projects/a6d14f7fc5b04efcabbfb8042fb4f89f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.115510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d14f7fc5b04efcabbfb8042fb4f89f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:33.117531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:33.258365 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:33.261156 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:33.282255 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02423f-9752-4dd8-ad61-07abfa333704 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:33.287071 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:33.287828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.287999 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.288269 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] PATH_INFO: `/v3/projects/ae4ad1a5baae4f9d9f26d19adbd6cd6a` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.289659 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4ad1a5baae4f9d9f26d19adbd6cd6a)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:33.291589 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:33.353261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d14f7fc5b04efcabbfb8042fb4f89f', 'request_id': 'req-2bda4da6-334a-4442-abfb-e4ae3b623bef'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.359832 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d14f7fc5b04efcabbfb8042fb4f89f', 'request_id': 'req-2bda4da6-334a-4442-abfb-e4ae3b623bef'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.418611 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4ad1a5baae4f9d9f26d19adbd6cd6a', 'request_id': 'req-4ae47c7f-507b-4346-a687-9ee236e9ab8d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.424971 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4ad1a5baae4f9d9f26d19adbd6cd6a', 'request_id': 'req-4ae47c7f-507b-4346-a687-9ee236e9ab8d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.551134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d14f7fc5b04efcabbfb8042fb4f89f', 'request_id': 'req-2bda4da6-334a-4442-abfb-e4ae3b623bef'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.563310 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] The token cache is being invalidate because project a6d14f7fc5b04efcabbfb8042fb4f89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:33.563808 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.564484 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2bda4da6-334a-4442-abfb-e4ae3b623bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.566070 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1436/2843] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:32 2022] DELETE /identity/v3/projects/a6d14f7fc5b04efcabbfb8042fb4f89f => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:33.631144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4ad1a5baae4f9d9f26d19adbd6cd6a', 'request_id': 'req-4ae47c7f-507b-4346-a687-9ee236e9ab8d'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.641759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:33.651518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] The token cache is being invalidate because project ae4ad1a5baae4f9d9f26d19adbd6cd6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:33.651518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.651518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-4ae47c7f-507b-4346-a687-9ee236e9ab8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:33.651518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1408/2844] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:33 2022] DELETE /identity/v3/projects/ae4ad1a5baae4f9d9f26d19adbd6cd6a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:33.656629 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8265c70-3ab1-47f2-8c71-15c5db8cc755 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.657093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8265c70-3ab1-47f2-8c71-15c5db8cc755 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.657477 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8265c70-3ab1-47f2-8c71-15c5db8cc755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.685305 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-b8265c70-3ab1-47f2-8c71-15c5db8cc755 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:33.713799 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-b8265c70-3ab1-47f2-8c71-15c5db8cc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:33.759239 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1437/2845] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:33.768128 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4381-0303-47d8-8e35-9a290735f6f3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.768534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4381-0303-47d8-8e35-9a290735f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.768897 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4381-0303-47d8-8e35-9a290735f6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.791619 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-b68c4381-0303-47d8-8e35-9a290735f6f3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:33.792883 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-b68c4381-0303-47d8-8e35-9a290735f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:33.805003 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1409/2846] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:33.810097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8265c70-3ab1-47f2-8c71-15c5db8cc755 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:33.823970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8265c70-3ab1-47f2-8c71-15c5db8cc755 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:33.831053 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:33.831251 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.832093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.832436 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.833229 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:33.833648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:33.835524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:33.849681 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1438/2847] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:13:33.862387 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c4381-0303-47d8-8e35-9a290735f6f3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:33.874162 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c4381-0303-47d8-8e35-9a290735f6f3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:33.880113 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:33.880877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.885864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.885864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.885864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:33.885864 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:33.978828 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1410/2848] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:33 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:33.984306 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.001410 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffba1-8c29-4fe2-9b5b-18a2a301b6cb admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.066335 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.066952 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.067227 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.067563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.068234 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.070182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.078517 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:34.216090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1439/2849] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:33 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:34.220102 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.230661 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b229b0-acbf-452a-aacd-aa279b37f1a4 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.235252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.235917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.236201 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.236477 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.237165 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.239296 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.250250 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1411/2850] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:34.255844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.267186 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d83d4-492a-489f-bb64-b8e9ff851b15 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.272389 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f18da-0445-417f-b5db-2015796e068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.273420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f18da-0445-417f-b5db-2015796e068d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.274256 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f18da-0445-417f-b5db-2015796e068d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.274754 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f18da-0445-417f-b5db-2015796e068d admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.275758 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f18da-0445-417f-b5db-2015796e068d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.277753 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f18da-0445-417f-b5db-2015796e068d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.289099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1440/2851] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:34.293941 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.304798 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69954a-227a-43b0-a1fe-5cf2cbdd5bf9 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.309530 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.310187 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.310469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.310744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] PATH_INFO: `/v3/projects/5ba1d2e129bc4df0874b75a0b21d294c/users/7dd3820f26df49c78d5e57d02188ad16/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.326976 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba1d2e129bc4df0874b75a0b21d294c, user_id=7dd3820f26df49c78d5e57d02188ad16, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.329713 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.437105 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1412/2852] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:34 2022] PUT /identity/v3/projects/5ba1d2e129bc4df0874b75a0b21d294c/users/7dd3820f26df49c78d5e57d02188ad16/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:34.506115 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38098b82-92a3-4638-a714-c733fa70d446 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.506400 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38098b82-92a3-4638-a714-c733fa70d446 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.506683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38098b82-92a3-4638-a714-c733fa70d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.538327 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-38098b82-92a3-4638-a714-c733fa70d446 None None] MFA Rules not processed for user `7dd3820f26df49c78d5e57d02188ad16`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:34.539853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-38098b82-92a3-4638-a714-c733fa70d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:34.608016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1441/2853] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:34.613198 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.685234 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb752-01d3-4ac6-b8fe-ed0e9857d647 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.689981 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.690598 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.691403 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.691773 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.692401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.694320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.790084 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1413/2854] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:34 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:34.794903 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38098b82-92a3-4638-a714-c733fa70d446 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.807097 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38098b82-92a3-4638-a714-c733fa70d446 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.866394 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.867021 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.867510 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.867792 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.868435 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.870376 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.953257 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1442/2855] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:34 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:34.957765 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:34.968469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4fe19-0eed-4fe3-bf9b-0ae6346a1cb5 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:34.974358 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:34.974928 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:34.975211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:34.975534 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:34.976311 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:34.977917 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:34.990487 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1414/2856] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:34.994874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:35.005854 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff478-b4f1-40f7-b9e1-7022cd22fb72 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:35.010700 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:35.011381 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.011727 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.011970 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] PATH_INFO: `/v3/projects/9d5b7c23f8ae47cbbbf00b545f536bb8/users/e1f78d94449e4856af5c7989ed1df029/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.029836 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5b7c23f8ae47cbbbf00b545f536bb8, user_id=e1f78d94449e4856af5c7989ed1df029, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:35.032608 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:35.100268 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1443/2857] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:34 2022] PUT /identity/v3/projects/9d5b7c23f8ae47cbbbf00b545f536bb8/users/e1f78d94449e4856af5c7989ed1df029/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:35.104236 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:35.115145 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c828c4e-b1ea-4733-9657-cca7033e6bd8 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:35.178874 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fcaa5-de4c-469c-9a0a-05769f3a0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:35.179518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fcaa5-de4c-469c-9a0a-05769f3a0edf admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.179807 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fcaa5-de4c-469c-9a0a-05769f3a0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.180085 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fcaa5-de4c-469c-9a0a-05769f3a0edf admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.180733 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fcaa5-de4c-469c-9a0a-05769f3a0edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:35.182328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fcaa5-de4c-469c-9a0a-05769f3a0edf admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:35.193267 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1415/2858] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:35.197379 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:35.208127 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d23680-072f-4876-81cc-baf0f0fd2b35 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:35.213154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:35.213834 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.214114 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.214387 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] PATH_INFO: `/v3/projects/9d5b7c23f8ae47cbbbf00b545f536bb8/users/e1f78d94449e4856af5c7989ed1df029/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.216421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5b7c23f8ae47cbbbf00b545f536bb8, user_id=e1f78d94449e4856af5c7989ed1df029, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:35.219118 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:35.230283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1444/2859] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:35 2022] PUT /identity/v3/projects/9d5b7c23f8ae47cbbbf00b545f536bb8/users/e1f78d94449e4856af5c7989ed1df029/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:35.241166 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88bae8-4a26-4573-a98c-7cf58e83e2d5 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.241455 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88bae8-4a26-4573-a98c-7cf58e83e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.241728 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88bae8-4a26-4573-a98c-7cf58e83e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.250210 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:35.270009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fb88bae8-4a26-4573-a98c-7cf58e83e2d5 None None] MFA Rules not processed for user `e1f78d94449e4856af5c7989ed1df029`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:35.271278 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fb88bae8-4a26-4573-a98c-7cf58e83e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:35.351290 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1416/2860] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:35.361371 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:35.363482 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:35.387630 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:35.426144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1c54-423f-45b9-b2b2-a4fc1024a783 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:35.429982 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:35.430586 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:35.430874 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:35.431150 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:35.440531 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:35.442499 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:35.453262 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1445/2861] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:36.440795 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88bae8-4a26-4573-a98c-7cf58e83e2d5 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:36.450697 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88bae8-4a26-4573-a98c-7cf58e83e2d5 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:36.455380 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f78d94449e4856af5c7989ed1df029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b7c23f8ae47cbbbf00b545f536bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:36.455982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.456258 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.457143 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.457792 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:36.458097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:36.459734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:36.473453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1417/2862] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:36.478216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:36.488525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453b681-0667-4ca8-9a70-7507ac71e3ff service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:36.493336 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f78d94449e4856af5c7989ed1df029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b7c23f8ae47cbbbf00b545f536bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:36.493944 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.494232 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.494545 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.495178 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:36.497121 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:36.595241 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1446/2863] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:36 2022] POST /identity/v3/projects => generated 354 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:36.598717 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:36.609048 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4ca95-00c2-4d23-ac07-d1e29c6b0c7a tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:36.666822 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f78d94449e4856af5c7989ed1df029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b7c23f8ae47cbbbf00b545f536bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:36.667465 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.667752 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.668029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.668683 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:36.668985 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:36.670583 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:36.683850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1418/2864] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:36.721052 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:36.731585 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2005f-3b2f-49e6-9a34-50a9a1f9a543 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:36.736397 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f78d94449e4856af5c7989ed1df029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b7c23f8ae47cbbbf00b545f536bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:36.737028 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:36.737315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:36.737594 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] PATH_INFO: `/v3/projects/580ff9466c604ed09e57cf6217e64d8b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:36.739261 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=580ff9466c604ed09e57cf6217e64d8b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:36.741208 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:36.854146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580ff9466c604ed09e57cf6217e64d8b', 'request_id': 'req-2205558e-a0ac-40b2-85a7-ad0c024f737e'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:36.859869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580ff9466c604ed09e57cf6217e64d8b', 'request_id': 'req-2205558e-a0ac-40b2-85a7-ad0c024f737e'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:36.935300 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580ff9466c604ed09e57cf6217e64d8b', 'request_id': 'req-2205558e-a0ac-40b2-85a7-ad0c024f737e'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:36.948869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] The token cache is being invalidate because project 580ff9466c604ed09e57cf6217e64d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:36.949165 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:36.949857 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-2205558e-a0ac-40b2-85a7-ad0c024f737e tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:36.951467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1447/2865] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:36 2022] DELETE /identity/v3/projects/580ff9466c604ed09e57cf6217e64d8b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:37.595277 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:37.598436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:37.686144 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088e14-9aa7-4dba-b51a-543dabb6e168 tempest-VolumeQuotaClassesTest-1918065224 tempest-VolumeQuotaClassesTest-1918065224-project-admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:37.700750 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=100 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:37.746666 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:37.747302 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:37.747616 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:37.747913 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] PATH_INFO: `/v3/users/7dd3820f26df49c78d5e57d02188ad16` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:37.749114 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd3820f26df49c78d5e57d02188ad16)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:37.751174 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:37.950535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd3820f26df49c78d5e57d02188ad16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:37.951125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd3820f26df49c78d5e57d02188ad16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:37.958759 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd3820f26df49c78d5e57d02188ad16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:37.962206 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd3820f26df49c78d5e57d02188ad16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:37.971769 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd3820f26df49c78d5e57d02188ad16'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:38.049688 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1419/2866] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:37 2022] DELETE /identity/v3/users/7dd3820f26df49c78d5e57d02188ad16 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:38.055018 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:38.055606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:38.055606 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:38.074840 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:38.076078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:38.136185 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1448/2867] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:38.151790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:38.153674 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:38.216280 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa6fd-e758-4bff-a4e7-c5387a8d088e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:38.220088 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:38.220706 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:38.220983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:38.221252 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:38.231453 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:38.232894 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:38.243649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1420/2868] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:38.677969 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:38.679780 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:38.694091 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d26b9-5a2c-4d99-bb49-1dd94ca52807 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:38.699039 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:38.699719 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:38.700034 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:38.700315 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] PATH_INFO: `/v3/projects/5ba1d2e129bc4df0874b75a0b21d294c` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:38.704822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba1d2e129bc4df0874b75a0b21d294c)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:38.704822 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:38.729224 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:38.885563 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba1d2e129bc4df0874b75a0b21d294c', 'request_id': 'req-bba69f60-5764-4f23-8020-44da9889e7ff'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:38.891181 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba1d2e129bc4df0874b75a0b21d294c', 'request_id': 'req-bba69f60-5764-4f23-8020-44da9889e7ff'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:38.975406 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba1d2e129bc4df0874b75a0b21d294c', 'request_id': 'req-bba69f60-5764-4f23-8020-44da9889e7ff'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:38.988129 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] The token cache is being invalidate because project 5ba1d2e129bc4df0874b75a0b21d294c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:38.988421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:38.989104 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:38.990931 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1449/2869] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:38 2022] DELETE /identity/v3/projects/5ba1d2e129bc4df0874b75a0b21d294c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:38.995328 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:39.005362 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35603-8eb9-434d-aa2e-31ef75f68074 service neutron] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:39.045668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:39.065687 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:39.066863 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:39.067172 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:39.067480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] PATH_INFO: `/v3/users/e1f78d94449e4856af5c7989ed1df029` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:39.068668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f78d94449e4856af5c7989ed1df029)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:39.070587 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:39.332910 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f78d94449e4856af5c7989ed1df029'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:39.333637 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f78d94449e4856af5c7989ed1df029'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:39.348859 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f78d94449e4856af5c7989ed1df029'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:39.349830 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f78d94449e4856af5c7989ed1df029'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:39.367053 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-9dd76d47-d388-4244-bfcd-495b543aabf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f78d94449e4856af5c7989ed1df029'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:39.444952 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1421/2870] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:38 2022] DELETE /identity/v3/users/e1f78d94449e4856af5c7989ed1df029 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:39.943202 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:39.944731 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:39.959016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69f60-5764-4f23-8020-44da9889e7ff admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:40.023210 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:40.023875 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.024168 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.024434 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] PATH_INFO: `/v3/projects/9d5b7c23f8ae47cbbbf00b545f536bb8` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.025663 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5b7c23f8ae47cbbbf00b545f536bb8)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:40.027652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:40.141195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5b7c23f8ae47cbbbf00b545f536bb8', 'request_id': 'req-5c0fb696-83a1-408b-8400-c718a528f887'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:40.147664 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5b7c23f8ae47cbbbf00b545f536bb8', 'request_id': 'req-5c0fb696-83a1-408b-8400-c718a528f887'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:40.236682 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5b7c23f8ae47cbbbf00b545f536bb8', 'request_id': 'req-5c0fb696-83a1-408b-8400-c718a528f887'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:40.250350 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] The token cache is being invalidate because project 9d5b7c23f8ae47cbbbf00b545f536bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:40.250673 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:40.251595 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-5c0fb696-83a1-408b-8400-c718a528f887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:40.253155 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1450/2871] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:39 2022] DELETE /identity/v3/projects/9d5b7c23f8ae47cbbbf00b545f536bb8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:40.258601 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713c332-ab68-460d-86b6-15fe2fff2afe None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.259133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713c332-ab68-460d-86b6-15fe2fff2afe None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.259420 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713c332-ab68-460d-86b6-15fe2fff2afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.281064 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9713c332-ab68-460d-86b6-15fe2fff2afe None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:40.282289 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9713c332-ab68-460d-86b6-15fe2fff2afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:40.350171 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1422/2872] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:40.359421 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec698020-b337-4477-961a-3ef31dd07b1c None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.359714 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec698020-b337-4477-961a-3ef31dd07b1c None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.359992 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec698020-b337-4477-961a-3ef31dd07b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.380012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-ec698020-b337-4477-961a-3ef31dd07b1c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:40.381231 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-ec698020-b337-4477-961a-3ef31dd07b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:40.389457 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1451/2873] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:40.394401 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713c332-ab68-460d-86b6-15fe2fff2afe None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:40.406019 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713c332-ab68-460d-86b6-15fe2fff2afe None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:40.411819 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:40.412432 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.412710 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.412984 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.413647 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:40.413949 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:40.415849 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:40.428672 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1423/2874] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:40.433346 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec698020-b337-4477-961a-3ef31dd07b1c None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:40.445277 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec698020-b337-4477-961a-3ef31dd07b1c None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:40.450079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:40.450683 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.450966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.451247 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.451917 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:40.453833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:40.531646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1452/2875] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:40 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:40.537877 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:40.553185 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9b4b-d462-4e73-8652-339cca0e3a19 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:40.606131 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:40.618908 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:40.619557 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.619840 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.620116 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.620806 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:40.622724 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:40.723069 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1424/2876] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:40 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:40.728838 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:40.740033 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a29b7-52a8-44d9-929c-16b191a56823 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:40.761149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:40.761149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.761149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.761149 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.761684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:40.761684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:40.761684 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:40.764443 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1453/2877] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:40.770517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:40.783517 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe33c3-33d6-45ab-8577-029669fc4148 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:40.788642 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea52876-a4f8-49f7-911d-976bf1f2f2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:40.789249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52876-a4f8-49f7-911d-976bf1f2f2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.789797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52876-a4f8-49f7-911d-976bf1f2f2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.790125 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52876-a4f8-49f7-911d-976bf1f2f2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.790783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea52876-a4f8-49f7-911d-976bf1f2f2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:40.792429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea52876-a4f8-49f7-911d-976bf1f2f2f8 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:40.804538 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1425/2878] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:40.809132 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:40.820175 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acb8b2-d936-413a-8e8d-6b2c9ae461fd admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:40.824976 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:40.825679 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.825965 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.826244 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] PATH_INFO: `/v3/projects/6de264430cc0412e89ccbf73a95b65cc/users/73c79529ba424df78e9c1866eb5d3716/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.845093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de264430cc0412e89ccbf73a95b65cc, user_id=73c79529ba424df78e9c1866eb5d3716, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:40.847957 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:40.953080 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1454/2879] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:40 2022] PUT /identity/v3/projects/6de264430cc0412e89ccbf73a95b65cc/users/73c79529ba424df78e9c1866eb5d3716/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:40.963654 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21ff34-c48a-438a-95f4-e95e04f240b7 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:40.963938 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21ff34-c48a-438a-95f4-e95e04f240b7 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:40.980381 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21ff34-c48a-438a-95f4-e95e04f240b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:40.996218 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-2d21ff34-c48a-438a-95f4-e95e04f240b7 None None] MFA Rules not processed for user `73c79529ba424df78e9c1866eb5d3716`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:40.997489 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-2d21ff34-c48a-438a-95f4-e95e04f240b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:41.087725 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1426/2880] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:41.093321 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:41.183439 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13f70c-58fc-4888-8df3-af531864ad56 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:41.188535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:41.189151 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:41.189431 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:41.193110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:41.193110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:41.193110 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:41.336069 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1455/2881] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:41 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:41.341151 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21ff34-c48a-438a-95f4-e95e04f240b7 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:41.353249 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21ff34-c48a-438a-95f4-e95e04f240b7 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:41.426140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:41.426786 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:41.427067 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:41.427342 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:41.428009 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:41.430021 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:41.522347 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1427/2882] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:41 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:41.526772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:41.537807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7349d-fe91-4ba7-995a-02e5742eabea admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:41.542801 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:41.543441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:41.543726 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:41.543998 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:41.544660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:41.546265 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:41.558476 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1456/2883] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:41.562730 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:41.576276 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fcea-028b-4bab-b97c-a61e66c151cd admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:41.582054 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c463b-8e2d-4db7-8dc6-e0ed6059d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:41.582744 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c463b-8e2d-4db7-8dc6-e0ed6059d267 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:41.583026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c463b-8e2d-4db7-8dc6-e0ed6059d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:41.583298 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c463b-8e2d-4db7-8dc6-e0ed6059d267 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:41.584004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c463b-8e2d-4db7-8dc6-e0ed6059d267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:41.585715 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c463b-8e2d-4db7-8dc6-e0ed6059d267 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:41.598775 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1428/2884] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:41.603099 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:41.614182 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f69f-33cd-4a62-81c8-3b9ff3b83bfe admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:41.618869 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:41.619740 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:41.620071 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:41.620343 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] PATH_INFO: `/v3/projects/216e48068cc343c2be007f8a56842fff/users/f03bfe8bb6e9466ab598b5148b623070/roles/128a48837255468393c85bbc27310c38` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:41.636441 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216e48068cc343c2be007f8a56842fff, user_id=f03bfe8bb6e9466ab598b5148b623070, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:41.639160 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:41.746093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1457/2885] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:41 2022] PUT /identity/v3/projects/216e48068cc343c2be007f8a56842fff/users/f03bfe8bb6e9466ab598b5148b623070/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:41.758325 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08893e-47ac-4aa4-b39c-abf664abf06a None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:41.758612 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08893e-47ac-4aa4-b39c-abf664abf06a None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:41.758890 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08893e-47ac-4aa4-b39c-abf664abf06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:41.788247 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9b08893e-47ac-4aa4-b39c-abf664abf06a None None] MFA Rules not processed for user `f03bfe8bb6e9466ab598b5148b623070`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:41.789811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9b08893e-47ac-4aa4-b39c-abf664abf06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:41.811393 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:41.857563 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1429/2886] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:41.862384 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:41.936001 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4812d-83ae-4dad-a888-81f24a3e0a71 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:41.941741 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:41.942370 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:41.942653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:41.942932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:41.943610 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:41.945616 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:42.041195 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1458/2887] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:41 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:42.046383 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08893e-47ac-4aa4-b39c-abf664abf06a None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:42.057450 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08893e-47ac-4aa4-b39c-abf664abf06a None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:42.113951 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:42.114481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:42.114764 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:42.115041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] PATH_INFO: `/v3/users` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:42.115723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:42.117667 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:42.221095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1430/2888] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:42 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:42.225853 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:42.236782 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460609-a536-4f5f-b309-86f449e8c1c3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:42.242214 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:42.242833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:42.243144 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:42.243454 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:42.244113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:42.245761 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:42.248282 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:42.257956 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1459/2889] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:42.266098 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:42.278268 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e2d4c-c14d-4f0e-a6aa-4ac54358c59c admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:42.283684 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:42.284336 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:42.285115 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:42.285396 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] PATH_INFO: `/v3/projects/1989909f1fb44c92855d0cd22d0d623e/users/ea63f4c503d64f31915770687934925f/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:42.301779 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1989909f1fb44c92855d0cd22d0d623e, user_id=ea63f4c503d64f31915770687934925f, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:42.304564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:42.387390 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1431/2890] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:42 2022] PUT /identity/v3/projects/1989909f1fb44c92855d0cd22d0d623e/users/ea63f4c503d64f31915770687934925f/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:42.391486 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:42.403559 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b318c-8582-456d-888e-c740acf161a3 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:42.475535 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad230476-5f81-4a17-864f-95255ee82db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:42.476164 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230476-5f81-4a17-864f-95255ee82db9 admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:42.476450 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230476-5f81-4a17-864f-95255ee82db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:42.476725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230476-5f81-4a17-864f-95255ee82db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:42.477418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad230476-5f81-4a17-864f-95255ee82db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:42.479041 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad230476-5f81-4a17-864f-95255ee82db9 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:42.490259 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1460/2891] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:42.494664 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:42.506510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1be5d-403e-4486-ad35-e5356342177e admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:42.511436 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:42.512095 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:42.512373 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:42.512649 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] PATH_INFO: `/v3/projects/1989909f1fb44c92855d0cd22d0d623e/users/ea63f4c503d64f31915770687934925f/roles/5eebc7f04cfc4979a378bf94830482af` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:42.514609 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1989909f1fb44c92855d0cd22d0d623e, user_id=ea63f4c503d64f31915770687934925f, role_id=5eebc7f04cfc4979a378bf94830482af)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:42.517275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:42.528046 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1432/2892] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:42 2022] PUT /identity/v3/projects/1989909f1fb44c92855d0cd22d0d623e/users/ea63f4c503d64f31915770687934925f/roles/5eebc7f04cfc4979a378bf94830482af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:42.539807 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:42.540093 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:42.540372 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:42.569653 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] MFA Rules not processed for user `ea63f4c503d64f31915770687934925f`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:42.570880 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:42.655304 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1461/2893] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:42.667004 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:42.669737 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:42.732063 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5852a-6224-4de4-81ec-7a839108bf05 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:42.736041 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:42.736650 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:42.736923 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:42.737193 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:42.747097 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:42.748575 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:42.759961 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1433/2894] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:44.086523 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:44.087999 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:44.102418 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a684c0-9c03-4575-8b9f-cf168c00e3b1 None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:44.105994 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:44.106589 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:44.106871 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:44.107143 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:44.167319 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:44.168712 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:44.177733 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1462/2895] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:49.254086 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.262802 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95917-197f-4aa3-9e1d-75aed5b527ee service cinder] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.266528 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adad18-9bf1-4756-91da-51435d7343f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.267121 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adad18-9bf1-4756-91da-51435d7343f6 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.267430 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adad18-9bf1-4756-91da-51435d7343f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.267707 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adad18-9bf1-4756-91da-51435d7343f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.280679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:49.327047 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adad18-9bf1-4756-91da-51435d7343f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.328595 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adad18-9bf1-4756-91da-51435d7343f6 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.341008 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1434/2896] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:53.656660 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:53.681915 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=100 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:53.734584 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3151655-540c-49a1-8425-1984df183ee7 service cinder] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:53.740297 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:53.741154 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:53.741445 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:53.741718 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] PATH_INFO: `/v3/users/73c79529ba424df78e9c1866eb5d3716` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:53.743007 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c79529ba424df78e9c1866eb5d3716)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:53.745042 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:53.945864 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c79529ba424df78e9c1866eb5d3716'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:53.953659 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c79529ba424df78e9c1866eb5d3716'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:53.954407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c79529ba424df78e9c1866eb5d3716'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:53.967273 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c79529ba424df78e9c1866eb5d3716'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:54.049417 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c79529ba424df78e9c1866eb5d3716'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:54.057122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1463/2897] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:53 2022] DELETE /identity/v3/users/73c79529ba424df78e9c1866eb5d3716 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:54.062099 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:54.062629 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:54.065925 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:54.083133 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:54.084429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:54.156703 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1435/2898] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:54.167345 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:54.168950 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:54.226725 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c163f-2175-4341-bc58-38f86f71c21c admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:54.230204 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:54.230812 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:54.231086 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:54.231353 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:54.241338 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:54.242772 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:54.252746 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1464/2899] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:54.736929 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:54.739592 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:54.751217 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b932b52-dba1-4863-99c4-2473d5f7d08c None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:54.756345 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:54.756996 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:54.757275 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:54.757555 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] PATH_INFO: `/v3/projects/6de264430cc0412e89ccbf73a95b65cc` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:54.758783 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de264430cc0412e89ccbf73a95b65cc)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:54.760801 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:54.954549 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de264430cc0412e89ccbf73a95b65cc', 'request_id': 'req-c2625784-9683-48a4-94fc-7b22f19c8993'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:54.962481 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de264430cc0412e89ccbf73a95b65cc', 'request_id': 'req-c2625784-9683-48a4-94fc-7b22f19c8993'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.064811 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de264430cc0412e89ccbf73a95b65cc', 'request_id': 'req-c2625784-9683-48a4-94fc-7b22f19c8993'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.078164 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] The token cache is being invalidate because project 6de264430cc0412e89ccbf73a95b65cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:55.078511 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.079168 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.080785 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1436/2900] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:54 2022] DELETE /identity/v3/projects/6de264430cc0412e89ccbf73a95b65cc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:55.086012 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:55.099524 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b48e6-4008-412f-ac8c-19eff32ca476 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:55.151036 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:55.174113 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:55.174769 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.175090 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.176006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] PATH_INFO: `/v3/users/f03bfe8bb6e9466ab598b5148b623070` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.177293 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03bfe8bb6e9466ab598b5148b623070)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:55.179392 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:55.417398 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03bfe8bb6e9466ab598b5148b623070'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.426561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03bfe8bb6e9466ab598b5148b623070'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.427355 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03bfe8bb6e9466ab598b5148b623070'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.444079 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03bfe8bb6e9466ab598b5148b623070'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.552216 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03bfe8bb6e9466ab598b5148b623070'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.563642 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1465/2901] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:55 2022] DELETE /identity/v3/users/f03bfe8bb6e9466ab598b5148b623070 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:56.164376 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.166416 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.182560 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2625784-9683-48a4-94fc-7b22f19c8993 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.228510 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.252480 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.254982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.254982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.254982 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] PATH_INFO: `/v3/projects/216e48068cc343c2be007f8a56842fff` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.255696 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216e48068cc343c2be007f8a56842fff)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.257634 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.374244 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216e48068cc343c2be007f8a56842fff', 'request_id': 'req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.380446 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216e48068cc343c2be007f8a56842fff', 'request_id': 'req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.460708 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216e48068cc343c2be007f8a56842fff', 'request_id': 'req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.474368 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] The token cache is being invalidate because project 216e48068cc343c2be007f8a56842fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:56.474668 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.475334 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.477006 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1437/2902] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:56 2022] DELETE /identity/v3/projects/216e48068cc343c2be007f8a56842fff => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:56.481428 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.483000 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.497016 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996b449-8f80-4e53-8c28-71536ff97f82 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.558308 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.558948 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.559226 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.559536 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] PATH_INFO: `/v3/users/ea63f4c503d64f31915770687934925f` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.560742 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea63f4c503d64f31915770687934925f)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.562710 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.790288 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea63f4c503d64f31915770687934925f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.797844 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea63f4c503d64f31915770687934925f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.798571 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea63f4c503d64f31915770687934925f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.804670 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.814652 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea63f4c503d64f31915770687934925f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.935448 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-899cf61e-579b-4132-954d-29806806cbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea63f4c503d64f31915770687934925f'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.942006 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1466/2903] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:56 2022] DELETE /identity/v3/users/ea63f4c503d64f31915770687934925f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:57.462979 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.464680 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.488260 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d7c2-d374-44a8-a3a5-b255c0c31fa3 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.547564 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.548112 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.548421 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.548695 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] PATH_INFO: `/v3/projects/1989909f1fb44c92855d0cd22d0d623e` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.549824 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1989909f1fb44c92855d0cd22d0d623e)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.552292 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.704967 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1989909f1fb44c92855d0cd22d0d623e', 'request_id': 'req-7f770408-2605-4c83-98e2-b5ef8fb0ae48'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:57.711983 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1989909f1fb44c92855d0cd22d0d623e', 'request_id': 'req-7f770408-2605-4c83-98e2-b5ef8fb0ae48'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:57.809400 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1989909f1fb44c92855d0cd22d0d623e', 'request_id': 'req-7f770408-2605-4c83-98e2-b5ef8fb0ae48'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:57.818442 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:57.822117 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] The token cache is being invalidate because project 1989909f1fb44c92855d0cd22d0d623e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:57.822418 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:57.823026 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-7f770408-2605-4c83-98e2-b5ef8fb0ae48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:57.824515 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1438/2904] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:57 2022] DELETE /identity/v3/projects/1989909f1fb44c92855d0cd22d0d623e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:57.830566 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961144-1347-4ec1-9873-4f1d3421b58b None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.831283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961144-1347-4ec1-9873-4f1d3421b58b None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.831283 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961144-1347-4ec1-9873-4f1d3421b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.851762 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-fb961144-1347-4ec1-9873-4f1d3421b58b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.853017 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-fb961144-1347-4ec1-9873-4f1d3421b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.914777 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1467/2905] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:57.923524 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79be7d-6808-4afb-958b-8e374f2f2ff3 None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.923873 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79be7d-6808-4afb-958b-8e374f2f2ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.924154 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79be7d-6808-4afb-958b-8e374f2f2ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.944498 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-fa79be7d-6808-4afb-958b-8e374f2f2ff3 None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.946140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-fa79be7d-6808-4afb-958b-8e374f2f2ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.954096 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1439/2906] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:57.958939 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961144-1347-4ec1-9873-4f1d3421b58b None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.968713 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961144-1347-4ec1-9873-4f1d3421b58b None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.973281 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.973881 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.974158 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.974429 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] PATH_INFO: `/v3/domains` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.975078 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:57.975388 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.977005 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.988689 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1468/2907] 10.222.0.62 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:57.993215 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79be7d-6808-4afb-958b-8e374f2f2ff3 None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.002338 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79be7d-6808-4afb-958b-8e374f2f2ff3 None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.007911 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.008518 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.008907 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.009186 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.009823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.011797 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.103466 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1440/2908] 10.222.0.62 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:58.108095 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.119711 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0900fd2-cd88-4f36-b474-cb143486e33d admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.175958 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.176561 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.176843 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.177119 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] PATH_INFO: `/v3/users` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.177744 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.179685 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.295242 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1469/2909] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:58 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:58.299568 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.310129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e80b-e728-43dd-bb3b-8a3103b8c4fc admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.314839 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.315469 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.315762 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.316029 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.316671 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.318271 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.329031 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1441/2910] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:58.333648 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.343828 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02fcd0-3a66-42c1-a109-efa31366784f admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.362167 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9d271-d0b6-42c5-8a4b-2a0afe8e527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.362991 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9d271-d0b6-42c5-8a4b-2a0afe8e527b admin admin] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.363546 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9d271-d0b6-42c5-8a4b-2a0afe8e527b admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.363962 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9d271-d0b6-42c5-8a4b-2a0afe8e527b admin admin] PATH_INFO: `/v3/roles` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.364966 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9d271-d0b6-42c5-8a4b-2a0afe8e527b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.366789 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9d271-d0b6-42c5-8a4b-2a0afe8e527b admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.378420 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1470/2911] 10.222.0.62 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:58.383208 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.395044 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4522-0d79-4b44-a1ff-fff64ad5ed05 admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.399790 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.401723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] REQUEST_METHOD: `PUT` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.401723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.401723 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] PATH_INFO: `/v3/projects/362641c7a7d2462498979b8c220a7ba8/users/338cd255158b4d8daf2770cd556cd02b/roles/128a48837255468393c85bbc27310c38` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.418526 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] RBAC: Authorizing `identity:create_grant(project_id=362641c7a7d2462498979b8c220a7ba8, user_id=338cd255158b4d8daf2770cd556cd02b, role_id=128a48837255468393c85bbc27310c38)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.421320 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.506946 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1442/2912] 10.222.0.62 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:58 2022] PUT /identity/v3/projects/362641c7a7d2462498979b8c220a7ba8/users/338cd255158b4d8daf2770cd556cd02b/roles/128a48837255468393c85bbc27310c38 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:58.520027 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157464-c039-4ca9-bbb6-9b051379bb1d None None] REQUEST_METHOD: `POST` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.520467 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157464-c039-4ca9-bbb6-9b051379bb1d None None] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.520859 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157464-c039-4ca9-bbb6-9b051379bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.549147 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.auth.core [None req-0f157464-c039-4ca9-bbb6-9b051379bb1d None None] MFA Rules not processed for user `338cd255158b4d8daf2770cd556cd02b`. Rule list: `[]` (Enabled: `True`). {{(pid=88549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:58.550433 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0f157464-c039-4ca9-bbb6-9b051379bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:58.582720 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:58.619578 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1471/2913] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:58.629158 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.631137 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:58.692211 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecda2ae-e5fe-45e2-a87d-4d95617c57af admin admin] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.695978 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01e5e-47eb-4de0-90f5-d57eb5a1f563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b743dbcea55f4ab7b339eb7dc6e30630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.696586 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01e5e-47eb-4de0-90f5-d57eb5a1f563 service cinder] REQUEST_METHOD: `GET` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.696861 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01e5e-47eb-4de0-90f5-d57eb5a1f563 service cinder] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.697129 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01e5e-47eb-4de0-90f5-d57eb5a1f563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.708303 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01e5e-47eb-4de0-90f5-d57eb5a1f563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.709746 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01e5e-47eb-4de0-90f5-d57eb5a1f563 service cinder] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.719140 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1443/2914] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:08.715319 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:08.760946 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=12 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:10.061407 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f157464-c039-4ca9-bbb6-9b051379bb1d None None] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:10.126361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f157464-c039-4ca9-bbb6-9b051379bb1d None None] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:10.130907 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:10.131554 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:10.131833 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:10.132102 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] PATH_INFO: `/v3/users/338cd255158b4d8daf2770cd556cd02b` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:10.133215 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338cd255158b4d8daf2770cd556cd02b)` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:10.135122 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:10.325366 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338cd255158b4d8daf2770cd556cd02b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:10.333146 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338cd255158b4d8daf2770cd556cd02b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:10.333883 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338cd255158b4d8daf2770cd556cd02b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:10.346463 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338cd255158b4d8daf2770cd556cd02b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:10.431972 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.notifications [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338cd255158b4d8daf2770cd556cd02b'} {{(pid=88549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:10.438361 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1472/2915] 10.222.0.62 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:10 2022] DELETE /identity/v3/users/338cd255158b4d8daf2770cd556cd02b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:10.442850 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] REQUEST_METHOD: `POST` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:10.443355 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:10.443483 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:10.462679 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.auth.core [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] MFA Rules not processed for user `2526f2a72f3a412d8bafb65717ad2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:10.463933 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:10.529594 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1444/2916] 10.222.0.62 () {58 vars in 958 bytes} [Thu Aug 18 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:10.540362 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:10.541787 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:10.600781 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16938a4-9dd3-4310-bc69-48ad39dc45d6 admin admin] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:10.604414 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162eb7d6a9894e4ca60aa8da4537a1ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:10.605023 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:10.605307 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:10.605656 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:10.614909 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:10.616583 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:10.626137 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1473/2917] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:11.069734 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] Authenticating user token {{(pid=88548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:11.071251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.fernet_utils [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:11.089876 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414f3d-564b-4754-93ca-faad4a96b21b None None] Validating token access rules against request {{(pid=88548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:11.094842 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2526f2a72f3a412d8bafb65717ad2b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6113ebebf7b4a1a9829f6a6a5263233', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:11.096251 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:11.096535 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] SCRIPT_NAME: `/identity` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:11.096810 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] PATH_INFO: `/v3/projects/362641c7a7d2462498979b8c220a7ba8` {{(pid=88548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:11.098413 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362641c7a7d2462498979b8c220a7ba8)` {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:11.100429 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] RBAC: Authorization granted {{(pid=88548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:11.224576 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362641c7a7d2462498979b8c220a7ba8', 'request_id': 'req-af8a99a3-3b89-4fe7-a32f-2a0b46355977'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:11.230155 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362641c7a7d2462498979b8c220a7ba8', 'request_id': 'req-af8a99a3-3b89-4fe7-a32f-2a0b46355977'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:11.318032 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362641c7a7d2462498979b8c220a7ba8', 'request_id': 'req-af8a99a3-3b89-4fe7-a32f-2a0b46355977'} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:11.330018 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] The token cache is being invalidate because project 362641c7a7d2462498979b8c220a7ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:11.330312 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:11.330988 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG keystone.notifications [None req-af8a99a3-3b89-4fe7-a32f-2a0b46355977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:11.332543 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: [pid: 88548|app: 0|req: 1445/2918] 10.222.0.62 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:11 2022] DELETE /identity/v3/projects/362641c7a7d2462498979b8c220a7ba8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:20.621932 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:21.326823 dv-cinder-852654-2-iscsi devstack@keystone.service[88548]: DEBUG dbcounter [-] [88548] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:17:35.416107 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] Authenticating user token {{(pid=88549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:17:35.417550 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:17:35.488525 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2774599-352b-4429-8261-41891fb440a5 service neutron] Validating token access rules against request {{(pid=88549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:17:35.550643 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809810f-8669-4647-86bd-97edf83a1cba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee628c7459142eca1ebb60e1acfbeb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b0bf8795f8481eb78257251b454156', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:17:35.551249 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809810f-8669-4647-86bd-97edf83a1cba service placement] REQUEST_METHOD: `GET` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:17:35.551564 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809810f-8669-4647-86bd-97edf83a1cba service placement] SCRIPT_NAME: `/identity` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:17:35.551842 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809810f-8669-4647-86bd-97edf83a1cba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:17:35.553646 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.fernet_utils [None req-0809810f-8669-4647-86bd-97edf83a1cba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:17:35.567481 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809810f-8669-4647-86bd-97edf83a1cba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:17:35.569134 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809810f-8669-4647-86bd-97edf83a1cba service placement] RBAC: Authorization granted {{(pid=88549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:17:35.580497 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: [pid: 88549|app: 0|req: 1474/2919] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Aug 18 21:17:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:17:45.575603 dv-cinder-852654-2-iscsi devstack@keystone.service[88549]: DEBUG dbcounter [-] [88549] Writing DB stats keystone:SELECT=58 {{(pid=88549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}